HYPERSPECTRAL  IMAGERY: 
Warfighting  Through  a  Different  Set  of  Eyes 


by 

Paul  J.  Pabich,  Lieutenant  Colonel,  USAF 


Oetober  2002 
Oeeasional  Paper  No.  31 
Center  for  Strategy  and  Teehnology 
Air  War  College 


Air  University 

Maxwell  Air  Foree  Base,  Alabama 


Report  Documentation  Page 

Form  Approved 

0MB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  0MB  control  number. 

1.  REPORT  DATE 

OCT  2002  TYPE 

3.  DATES  COVERED 

00-00-2002  to  00-00-2002 

4.  TITLE  AND  SUBTITLE 

Hyperspectral  Imagery:  Warfighting  Through  a  Different  Set  of  Eyes 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Air  University, Air  War  College, Center  for  Strategy  and 

Technology, Maxwell  AFB,AL, 36112 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distrihution  unlimited 

13.  SUPPLEMENTARY  NOTES 

The  original  document  contains  color  images. 

14.  ABSTRACT 

15.  SUBJECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF:  17.  LIMITATION  OF 

18.  NUMBER  19a.  NAME  OF 

a.  REPORT  b.  ABSTRACT  c.  THIS  PAGE 

unclassified  unclassified  unclassified 

72 

standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Hyperspectral  Imagery: 
Warfighting  Through  a  Different  Set  of  Eyes 


Paul  J.  Pabich,  Lieutenant  Colonel,  USAF 


Oetober  2002 


The  Oeeasional  papers  series  was  established  by  the  Center  for  Strategy 
and  Teehnology  as  a  forum  for  researeh  on  topies  that  re  fleet  long-term 
strategie  thinking  about  teehnology  and  its  implieations  for  U.S.  national 
seeurity.  Copies  of  No.  31  in  this  series  are  available  from  the  Center  for 
Strategy  and  Teehnology,  Air  War  College,  325  Chennault  Cirele, 
Maxwell  AFB,  Alabama  36112.  The  fax  number  is  (334)  953-6158; 
phone  (334)  953-6460. 


Oeeasional  Paper  No.  31 
Center  for  Strategy  and  Teehnology 


Air  University 

Maxwell  Air  Foree  Base,  Alabama  36112 


Contents 

Illustrations . i 

Disclaimer . ii 

Author . iii 

Acknowledgements . iv 

I.  Introduction . 1 

II.  Current  Hyperspectral  Imagery  Status . 9 

III.  Challenges:  Vision,  Doctrine,  and  the  Intelligence  Cycle . 23 

IV.  Recommendations . 37 


Notes 


,49 


Illustrations 

Figure  1  Spectral  signatures  constructed  from  AVIRIS  sensor . 2 

Figure  2  Wavelength  groupings  for  HSI  Sensors . 3 

Figure  3  Example  of  a  hypercube . 5 

Figure  4:  Comparison  of  Two  False-Color  HSI  Images  with 

Natural  Color  Photo . 6 

Figure  5  The  Intelligence  Cycle . 31 


1 


Disclaimer 


The  views  expressed  in  this  aeademie  researeh  paper  are  those  of 
the  author  and  do  not  refleet  the  offieial  poliey  or  position  of  Air 
University,  the  US  government  or  the  Department  of  Defense.  In 
aecordance  with  Air  Foree  Instruetion  51-303,  it  is  not  eopyrighted,  but  is 
the  property  of  the  United  States  government. 


Author 

Lieutenant  Colonel  Paul  J.  Pabieh  graduated  from  the  Air  War 
College,  Maxwell  Air  Force  Base,  Alabama,  in  June  2002.  In  1980,  he 
was  a  Distinguished  Graduate  of  Air  Force  Reserve  Officer  Training 
Corps  from  the  University  of  Wisconsin-Madison.  A  career  space  officer, 
he  began  his  space  systems  experience  with  Orbital  Analyst  Training  at 
Peterson  Air  Force  Base,  Colorado.  Following  training.  Colonel  Pabieh 
was  assigned  to  the  Alternate  Space  Computation  Center,  20**^  Missile 
Warning  Squadron,  Eglin  Air  Force  Base,  Florida,  and  in  1983,  he  was 
part  of  the  initial  cadre  forming  the  U*  Space  Wing  at  Peterson  Air  Force 
Base  as  part  of  the  then  new  Air  Force  Space  Command.  In  1985,  Colonel 
Pabieh  was  selected  to  attend  the  Air  Force  Institute  of  Technology, 
Wright-Patterson  Air  Force  Base,  Ohio,  where  he  earned  a  Master  of 
Science  degree  in  Space  Operations  in  1986.  He  was  next  assigned  to  the 
Air  Force  Operational  Test  and  Evaluation  Center,  where  he  began  test 
planning  for  the  upgrades  to  the  Defense  Support  Program,  the  United 
States’  space-borne  intercontinental  ballistic  missile  warning  system. 
Colonel  Pabieh  returned  to  operations  in  1990  as  the  Chief  of  Tactical 
Operations  at  the  19*’^  Space  Surveillance  Squadron,  Pirinclik  Air  Station, 
Turkey.  In  1991,  he  was  once  again  assigned  to  the  test  community  as  a 
branch  chief  at  Air  Eorce  Space  Command,  overseeing  the  testing  of  the 
command’s  passive  space  surveillance  sensors.  He  then  moved  to 
Vandenberg  Air  Eorce  Base,  California,  first  as  the  executive  officer  to  the 
Commander,  14*  Air  Eorce,  and  in  1996  he  assumed  command  of 
Detachment  1,  22d  Space  Operations  Squadron,  a  satellite  command  and 
control  facility.  His  final  tour  prior  to  Air  War  College  was  once  again  in 
the  test  community  at  the  Air  Eorce  Operational  Test  and  Evaluation 
Center  where  he  served  as  Deputy  Director  of  the  Air  &  Space  Mission 
Directorate,  overseeing  the  Center’s  initial  test  efforts  for  all  its  test 
programs. 


Acknowledgements 


I  begin  by  thanking  Lt  Col  John  Geis  of  the  Air  War  College 
Center  for  Strategy  and  Teehnology  without  whose  advice,  guidance,  and 
prodding,  this  paper  would  not  have  been  possible.  I  also  wish  to  thank 
the  many  people  who  gave  so  willingly  of  their  time  during  the  interview 
process.  In  many  instances,  my  request  for  “a  few  minutes  of  your  time” 
resulted  in  interviews  lasting  well  over  an  hour.  I  thank  Mr.  Marc 
Rodriguez  and  Dr.  Tom  Caudill  for  their  expertise  and  their  continuing 
patience  during  this  period.  Finally,  I  must  thank  my  family  for  their  love 
and  support.  They  sacrificed  much. 


Hyperspectml  Imagery...! 


I.  Introduction 

Hyperspectral  Imagery,  or  HSI,  is  a  sophisticated,  versatile 
intelligence  gathering  technology  that  could  potentially  enable  the  US 
military  to  make  significant  strides  towards  improving  the  preparation  for 
and  execution  of  its  missions.  Many  of  the  difficulties  in  bringing  the 
promise  of  HSI  to  fruition  have  very  little  to  do  with  the  technology  itself 
As  will  be  discussed  shortly,  HSI  technology  has  been  successfully 
demonstrated  in  a  variety  of  diverse  applications.  In  point  of  fact,  it  is  the 
versatility  of  HSI  that  may  be  hindering  its  implementation  into  the 
mainstream  of  the  U.S.  military’s  intelligence  gathering  capability.  The 
objective  of  this  paper  is  threefold.  The  first  goal  is  to  introduce  the 
reader  to  both  the  technology  itself  and  the  myriad  potential  applications 
of  Hyperspectral  Imagery.  The  second  goal  is  to  realistically  examine  the 
challenges  that  HSI  must  overcome,  specifically  in  the  areas  of  how  HSI 
fits  into  the  world  of  joint  vision,  intelligence  doctrine,  and  the 
intelligence  cycle.  Finally,  the  paper  will  provide  a  series  of 
recommendations — some  focused  on  organizational  issues  and  others  on 
acquisition  issues — that  will  address  the  majority  of  the  challenges  faced 
by  the  intelligence  community  as  they  endeavor  to  incorporate  an  HSI 
capability  into  the  U.S.  intelligence  community. 

Hyperspectral  Imaging  Technology  Concepts 

While  the  basic  concept  behind  HSI  is  relatively  straightforward, 
the  implementation  is  far  more  difficult.  In  most  applications,  HSI  sensors 
collect  sunlight  reflected  from  a  target  area  into  a  number  of  narrow 
wavelength  bins,  usually  across  the  visible  or  infrared  (or  both)  portions  of 
the  electromagnetic  spectrum.  These  bins  of  photons  are  both  spectrally 
and  spatially  resolved  and  thus  can  be  used  to  generate  a  variety  of 
“images”  of  the  target  area.  The  real  key  to  HSI  lies  in  the  concept  of 
spectral  signatures.  In  simple  terms,  all  materials  will  transmit,  reflect,  or 
absorb  electromagnetic  radiation  based  on  the  inherent  physical  structure 
and  chemical  composition  of  the  material  and  the  wavelength  of  the 
radiation.  Said  in  another  way,  for  any  given  material,  the  amount  of 
electromagnetic  radiation  that  is  absorbed,  reflected  or  transmitted  varies 
with  the  wavelength  or  frequency  of  the  radiation.  If  the  percentage  of 
reflectance  for  a  given  material  is  plotted  across  a  range  of  wavelengths. 
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the  resulting  eurve  is  referred  to  as  the  speetral  signature  for  that  material.* 
Beeause  the  speetral  signature  is  different  and  indeed  unique  for  each 
material,  it  should  be  possible  to  discriminate  between  one  material  and 
another  based  on  differences  in  spectral  signatures  of  the  materials.  For 
example,  HSI  can  differentiate  between  desert  and  farmland.  Not  only  are 
broad  differences  such  as  those  just  noted  detectable,  it  is  also  possible  to 
identify  particular  materials  based  on  a  comparison  against  a  database  of 
known  signatures.  For  example,  as  shown  in  Figure  1,  within  a 
hyperspectral  view  of  farmland  it  should  be  possible  to  differentiate  a 
barley  crop  from  potatoes.  This  concept  forms  the  basis  for  FiSI. 


Figure  1:  Spectral  Signatures  Constructed  From  AVIRIS  Sensor 

The  available  literature  contains  several  disparate  definitions  for 
the  types  of  sensor  platforms  that  qualify  as  “hyperspectral”  systems. 
These  definitions  often  include  the  number  of  bands,  the  width  of  each 
spectral  band,  and  the  idea  that  the  bands  are  continuous  across  a  region 
rather  than  having  numerous  gaps  between  the  bands.  Additionally,  the 
spatial  resolution  (i.e.,  the  size  of  the  smallest  distinguishable  item  in  the 
scene)  can  vary  tremendously  between  sensors.  One  definition  for  an  FISI 
system  indicates  it  must  have  “at  least  sixteen  contiguous  bands  of  high 
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spectral  resolution  over  a  region  of  the  electromagnetic  spectrum;” 
another  source  describes  HSI  systems  by  the  spectral  width  of  the 
wavelength  bands,  e.g.,  .01  micrometer  (pm)."^  As  one  might  suspect, 
there  are  limited  a  limited  number  of  photons  available  for  collection 
during  a  scan  period  of  a  hyperspectral  system.  Therefore,  there  is  a 
tradeoff  between  the  number  of  bands  one  wishes  to  collect  in  and  the 
number  of  photons  one  might  reasonably  expect  to  collect  during  a  scan 
period.  Nevertheless,  because  the  true  strength  of  Hyperspectral  Imagery 
lies  in  its  ability  to  use  many  narrow  wavelength  bands  to  distinguish 
between  objects,  this  paper  will  consider  HSI  systems  as  sensors  that 
collect  at  least  100  spectral  bands  of  .01pm  width.  Because  HSI  sensors 
will  only  be  effective  in  spectral  regions  where  the  atmosphere  is 
transparent,  the  nature  of  the  sensor  cannot  be  truly  “contiguous”  and  must 
be  broken  into  useful  bandwidth  groupings.  As  shown  in  the  Figure  2 
below,  HSI  practitioners  obtain  slices  of  bandwidth  from  five  wavelength 
groupings;  visible,  near  infrared  (NIR);  short  wavelength  infrared 
(SWIR)^;  medium  wavelength  infrared  (MWIR);  and  long  wavelength 
infrared  (LWIR).^ 


uv 

Vis  NIR 

SWIR 

MWIR 

LWIR 

I  ■- 

Ls  IL 

Mm 

caai 
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Frequency  Name 

Wavelength  (pm) 

Visible  (Blue,  Green,  and  Red) 

0.4-0.68 

NIR  (Near  Infrared) 

0.68-1 

SWIR  (Short  Wavelength  Infrared) 

1-2.5 

MWIR  (Medium  Wavelength  Infrared) 

8-5 

LWIR  (Long  Wavelength  Infrared) 

8-14 

Figure  2  Wavelength  Groupings  for  HSI  Sensors 

The  HSI  sensors  reviewed  for  this  paper  were  either  spaceborne  or 
airborne,  and  the  areas  of  interest  may  extend  from  several  meters  above 
the  earth’s  surface  (e.g.,  treetop  height)  to  a  few  meters  below  the  surface 
(e.g.,  coral  reef  depth).  These  systems  most  often  perform  in  the  visible  to 
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NIR  and  SWIR  ranges,  and  most  HSI  sensors  do  not  have  the  MWIR  or 
LWIR  eapability.  One  key  differenee  in  the  ehoiee  of  sensor  wavelength 
bands  is  that  photons  reeeived  by  the  sensor  in  the  visible  to  SWIR 
wavelengths  are  aetually  reflected  from  the  targeted  area.  This  obviously 
limits  the  utility  of  these  sensors  to  daylight  hours.  By  eontrast,  HSI 
sensors  that  have  MWIR  and  LWIR  eapability  will  eapture  photons  that 
are  emitted  from  the  targeted  area,  thus  opening  the  possibility  for 
nighttime  and  see-through-the-elouds  operations.^  If  the  proeessing 
algorithms  for  a  given  sensor  ean  separate  eloud  signals  from  the  ground 
signals,  the  eloud  portion  ean  be  subtraeted  from  the  overall  signal  and  the 
sensor  ean  essentially  "see"  through  elouds.  This  is  not  neeessarily  as 
easy  as  it  may  appear  as  the  physies  of  the  elouds  play  a  tremendously 
ehallenging  role.  However,  if  the  imaging  system  has  data  regarding 
eloud  temperature  as  well  as  moisture  profile,  then  algorithms  ean 
estimate  the  radianee  of  the  eloud.  The  system  ean  then  subtraet  the 
eloud’s  estimated  radianee  from  the  total  radianee  to  obtain  an  estimate  of 
the  ground  radianee,  thus  “seeing  through”  the  eloud.^  Therefore,  while 
elouds  and  nighttime  will  frustrate  HSI  eolleetion  in  the  visible  and  SWIR 
speetrums,  bringing  LWIR  sensors  into  the  pieture  ean  help  mitigate  that 
limitation,  though  they  do  bring  along  other  ehallenges  sueh  as  proper 
eooling  of  the  long  wavelength  sensor.^ 

To  appropriately  differentiate  between  HSI  and  other  types  of 
imagery,  this  paper  defines  panehromatie  imagery  as  blaek  &  white 
imagery  that  is  equally  sensitive  to  all  wavelengths  in  the  visible 
speetrum.'*’  Thus  a  green  tree  and  a  green  ear  will  eertainly  have  different 
shapes  in  the  image  but  their  shade  of  gray  will  be  the  same.  In  addition, 
multispeetral  imagery  is  defined  as  having  fewer  than  20  non-eontiguous 
speetral  bands  eovering  wavelengths  in  the  visible  to  SWIR  speetrum. 

Another  important  term  in  HSI  is  “hypereube,”  or  the  data  set  that 
is  provided  by  HSI  sensors.  Whereas  visual  images  typieally  have  spatial 
referenee  points  (e.g.,  latitude,  longitude  or  more  simply  X  and  Y), 
hypereubes  also  provide  a  third,  or  Z,  axis,  whieh  essentially  eontains  an 
X-Y  plane  for  eaeh  of  the  speetral  bands  observed  by  that  sensor.^'  Thus, 
hypereubes  provide  a  speetral  “depth”  that  is  exploited  to  identify  the 
materials  within  the  sensor’s  field  of  view.  One  ehallenge  faeing  the 
implementers  of  HSI  is  that  eaeh  hypereube  eontains  a  huge  amount  of 
data  that  must  be  moved  quiekly  within  the  available  eommunieations 
systems.  Thus  implementers  must  remain  eognizant  of  a  limited 
eommunieation  system  or  develop  other  ways  to  minimize  the  size  of 
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hypercubes.  A  visual  example  of  concepts  of  hypercube  depth  and  size 
concepts  just  discussed  is  shown  in  Figure  3. 


Figure  3  Example  of  a  Hypercube^^ 

A  not  so  obvious  point  that  needs  to  be  addressed  is  that  images  of 
a  given  area  from  hyperspectral  sensors  will  look  far  different  to  the  naked 
eye  than  they  do  when  appropriate  false  color  has  been  added.  As  shown 
in  Figure  4,  without  prior  knowledge,  it  would  be  difficult  to  judge  that 
these  multiple  views  from  an  FISI  imager  are  the  same  area.  In  this 
instance  the  leftmost  picture  is  near  to  natural  color,  and  the  two  images  to 
its  right  demonstrate  the  existence  of  various  minerals  in  the  scene  with 
the  reds,  yellows,  purples,  greens,  etc.  Given  this  scientific  foundation, 
the  next  portion  of  the  paper  will  briefly  review  some  of  the  potential 
military  applications  of  HSI. 
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Figure  4:  Comparison  of  Two  False-Color  HSI  Images  with  Natural 

Color  Photo^^ 

Uses  of  Hyperspectral  Imagery 

Hyperspectral  Imagery  holds  considerable  promise  for  many 
military  applications.  The  Navy  has  already  begun  developing  a 
spacebome  HSI  system  to  enhance  their  intelligence  preparation  of  the 
battlespace.  This  satellite-based  system  will  collect  data  for  areas  of 
interest  in  the  littoral  environment  to  include;  “underwater  hazards, 
currents,  oil  slicks,  bottom  type,  atmospheric  visibility,  tides, 
bioluminescence  potential,  beach  characterization,  atmospheric  water 
vapor,  and  subvisible  cirrus  along  with  terrestrial  images  of  vegetation  and 
soil.”'"*  The  utility  to  the  Navy  and  the  Marine  Corps  comes  from  the 
ability  to  predict  the  littoral  environment  with  much  better  confidence  and 
to  better  prepare  for  amphibious  assault.  The  satellite  will  be  able  to  look 
for  hazards  down  to  a  depth  of  twenty  meters  depending  on  water  clarity. 
In  contrast  to  other  types  of  sensors,  the  Navy  HSI  system  is  not  being 
built  for  quick  analysis  for  target  determination;  instead,  it  is  being 
developed  to  provide  longer-term  characterization  of  items  that  are  slow  to 
change  (e.g.,  reefs). 

The  Air  Force  also  has  many  uses  for  hyperspectral  imagery.  In 
particular,  the  service  is  looking  for  HSI  systems  that  can  provide  the 
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warfighter  with  near-real-time  information  to  enable  attaeks  on  targets 
sueh  as  tanks  hiding  under  trees.  The  Air  Foree  is  also  interested  in 
knowing  what  not  to  attack,  as  in  the  case  of  decoys.  Destroying  decoys 
can  be  a  costly  proposition.  At  $21,000  per  copy  for  the  tail  kits  alone. 
Joint  Direct  Attack  Munition  precision-guided  weapons  should  be 
zealously  guarded  from  unwittingly  attacking  decoys.'^  Since  decoys  will 
not  have  the  same  material  composition  as  real  targets,  HSI  should  be  able 
to  differentiate  between  the  two.  By  using  HSI  to  discriminate  between 
real  and  false  targets,  the  U.S.  can  save  money  by  avoiding  bad  targets  and 
at  the  same  time  wisely  expend  precision  munitions  on  true  targets. 
Defeating  camouflage  is  another  particularly  likely  mission  candidate  for 
HSI  because  even  though  the  camouflage  may  show  up  as  the  same  color 
as  the  surrounding  terrain  in  the  visual  spectrum,  its  material  makeup  will 
cause  it  to  reflect  very  differently  at  other  wavelengths. 

The  Army  and  Marine  Corps  (once  ashore)  would  likely  find  uses 

for  HSI  in  areas  such  as  large  area  coverage  to  characterize  a  theater  of 

interest.  HSI  could  also  be  used  to  focus  on  specific  targets  in  specific 

areas.  The  a  priori  knowledge  of  the  amount  of  grass,  trees,  shrubs,  desert, 

roads  and  the  moisture  content  of  the  surface  could  have  tremendous 

impact  on  their  ability  to  carry  out  operations.'^  Another  mission  for  HSI 

that  may  be  particularly  life  saving  is  its  potential  to  detect  landmines 

1 8 

along  roads  and  other  areas  where  humans  gather.  Other  concepts  also 
come  to  mind.  For  instance,  in  the  war  in  Afghanistan,  would  it  have  been 
possible  for  an  HSI  sensor  to  detect  concentrations  of  carbon  dioxide  in 
cave-laden  areas  where  the  fighting  was  occurring?  Would  these 
concentrations  possibly  represent  exhaust  holes  in  caves  occupied  by 
enemy  forces? 

This  brief  look  at  potential  service  operational  uses  for  HSI 
shouldn’t  cloud  the  potential  strategic  uses  that  could  emerge  for  the 
Department  of  Defense  (DOD).  In  years  to  come,  advanced  technologies 
such  as  HSI  could  be  used  to  monitor  international  treaty  compliance.  For 
example,  the  ability  of  HSI  to  detect  byproducts  from  the  manufacture  of 
chemicals  could  be  used  to  monitor  the  Chemical  Weapons  Convention 
Treaty.'^  So  too  could  HSI  be  used  to  monitor  the  war  on  drugs.  The 
fields  used  to  grow  illegal  drugs  as  well  as  the  facilities  used  to  process  the 
raw  materials  into  illegal  substances  could  be  discovered  via  HSI. 
Eradication  of  these  fields  and  facilities  could  totally  disrupt  the 
distribution  cycle,  thus  preventing  drug  profits  from  being  used  by  anti- 
American  organizations. 
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As  can  be  seen  by  even  in  this  brief  review  of  its  possible  uses, 
HSI  has  the  potential  to  dramatically  change  the  methods  by  which  the 
military  gathers  information  about  the  battlespace  across  the  services,  and 
in  turn,  makes  deeisions  at  the  strategie,  operational,  and  taetieal  levels  of 
war.  Having  reviewed  how  HSI  works  and  why  it  can  be  so  valuable,  the 
remainder  of  the  paper  will  seek  to  examine  the  question,  “If  airborne  and 
spacebome  Hyperspectral  Imagery  are  to  deliver  on  their  promise,  how 
should  this  teehnology  be  integrated  into  the  joint  warfighting  system?” 
The  paper  will  attempt  to  answer  this  question  by  addressing  important 
issues  in  the  following  three  seetions. 

In  the  next  section,  the  paper  provides  the  current  status  of 
hyperspectral  imagery  implementation.  It  will  show  some  of  the  halting 
steps  that  the  HSI  eommunity  worldwide  is  taking  to  turn  this  teehnology 
into  working  systems.  The  seetion  is  broken  into  three  major  subsets: 
military  systems,  non-military  systems,  and  ground  proeessing  systems. 
The  military  seetion  will  review  how  the  DOD  is  implementing  the 
teehnology  in  both  the  airborne  and  spaeeborne  arenas.  The  diseussion  of 
non-military  systems  such  as  NASA’s  Hyperion  satellite  will  demonstrate 
that,  at  least  in  the  spaeeborne  area,  non-military  systems  are  ahead  of 
those  in  the  military.  Also  included  in  this  review  is  a  description  of  some 
example  systems  that  demonstrate  how  the  DOD  is  also  working  data 
proeessing  issues. 

The  third  section  of  this  paper  describes  some  of  the  doetrinal  and 
organizational  ehallenges  that  eurrently  face  the  DOD  as  it  attempts  to 
fully  implement  hyperspeetral  imagery.  The  seetion  addresses  the 
placement  of  HSI  into  the  existing  vision  of  the  DOD  and  intelligence 
community  doctrine  and  will  show  that  HSI  fits  quite  easily  into  the 
Chairman,  Joint  Chiefs  of  Staff  vision  for  the  future  of  the  joint  foree, 
although  there  is  a  challenge  with  where  to  plaee  HSI  within  the 
intelligence  eommunity.  The  intelligence  eycle  and  the  functions  of 
tasking,  processing,  exploitation,  and  dissemination  will  also  be  reviewed 
in  detail.  Finally,  eurrent  thinking  for  integrating  HSI  with  other  forms  of 
intelligence  (e.g.,  radar)  will  also  be  noted. 

The  final  section  will  address  reeommendations  on  how  the 
military  can  implement  hyperspectral  imagery.  The  point  of  view  taken 
here  is  that  given  the  current  status  of  teehnology  and  doetrine,  how  can 
the  foree  of  the  future  best  integrate  HSI  into  its  warfighting  system?  The 
diseussion  foeuses  on  key  issues  sueh  as  doetrine,  organization,  and 
training. 


Hyperspectml  Imagery  ...9 


II.  Current  Hyperspectral  Imagery  Status 


While  the  theoretical  underpinnings  of  the  technology  are  already 
well  understood,  engineers  have  only  recently  gained  the  ability  to 
implement  the  theory.  The  following  discussion  examines  the  status  of 
HSI  implementation  but  does  not  focus  exclusively  on  the  technology.  In 
fact,  it  will  be  seen  that,  in  general,  much  more  thought  has  been  applied 
to  defining  the  proper  organization  and  use  of  HSI  assets,  than  has  been 
devoted  to  development  and  engineering  to  field  the  required  technologies. 

High  Level  HSI  Documentation 

One  of  the  first  things  noticeable  in  an  investigation  of 
hyperspectral  imagery  is  that  at  present  there  is  no  single  organization 
charged  with  oversight  of  HSI  for  the  DOD.  A  number  of  entities, 
however,  can  claim  large  stakes  in  the  area.  These  entities  include  the 
Central  Measurement  and  Signature  Intelligence  (MASINT)  Organization 
and  the  National  Space  Security  Architect.  The  Air  Force,  Navy,  and 
Army  also  have  specific  programs  they  are  attempting  to  implement. 
Despite  the  lack  of  a  lead  organization,  there  are  some  promising  signs  of 
purposeful  integration  of  HSI,  especially  in  the  processing  and 
dissemination  areas.  Most  notable  however  are  various  high  level 
documents  that  have  been  published,  or  are  currently  in  draft,  that  describe 
how  to  best  use  this  promising  technology.  A  review  of  several  of  these 
documents  is  now  provided  to  show  that  much  thought  is  being  devoted  to 
proper  implementation  of  HSI  at  both  the  national  and  service  levels. 

The  first  of  these  documents  is  a  Congressionally  mandated-report 
published  by  the  National  Space  Security  Architect  in  December  2000. 
The  National  Space  Security  Architect  organizationally  sits  under  the 
Under  Secretary  of  the  Air  Force  and  is  responsible  for  “developing, 
coordinating,  and  integrating”  future  space  system  architectures  for  the 
DOD  and  intelligence  agencies.  This  classified  report  listed  several 
items  that  could  potentially  improve  the  usefulness  of  HSI  to  the 
warfighter.  The  DOD’s  own  Space  Technology  Guide  repeatedly  listed 
HSI  as  a  supporting  technology  for  a  wide  variety  of  missions  from  target 
acquisition,  to  nuclear,  biological,  and  chemical  monitoring,  to 
atmospheric  monitoring. The  Air  Force  Scientific  Advisory  Board  has 
also  noted  that  HSI  has  “great  potential,”  though  the  members  also 
cautioned  that  because  of  technical  limitations  (e.g.,  cloud  cover  for  short 
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wavelength  infrared  sensors)  HSI  by  itself  is  insuffieient  to  be  a  primary 
souree  of  real-time  intelbgenee.^^ 

It  should  also  eome  as  no  surprise  that  national  level  politieal 
leaders  are  also  interested  in  this  topie.  Though  they  did  not  mention  HSI 
speeifioally,  the  US  Senate  has  devoted  mueh  time  to  Measurement  and 
Signal  Intelligenee  (the  most  likely  loeation  within  the  intelligenee 
eommunity  in  whieh  HSI  will  be  plaeed),  both  praising  its  potential  and 
simultaneously  eritieizing  its  implementation.  The  Senate  language  in  the 
Fiseal  Year  2001  budget  had  very  positive  words  to  say  about  how  these 
types  of  systems  ean  help  intelligenee  ageneies  aeeomplish  eritieal 
missions,  speeifioally  pointing  out  oountering  proliferation  of  weapons  of 
mass  destruotion  as  an  important  area  of  interest.  HSI  is  oertainly  oapable 
of  playing  a  signifioant  role  in  suoh  a  mission.  The  Senate  language  even 
noted  that,  historioally,  they  have  baoked  up  their  praise  with  signifioant 
new  funding.  Though  the  Senate  had  positive  words  for  the  eommunity, 
they  were  not  reluotant  to  heap  blame  on  the  intelligenee  eommunity  for 
its  inability  “to  eome  to  grips  with  resouroes,  management,  and 
organizational. ..defioienoies.”  In  Deoember  2000,  yet  another 

Congressionally  mandated  independent  oommission  report,  this  one  about 
the  National  Imagery  and  Mapping  Agenoy,  listed  HSI  as  one  of  several 
teohnologies  that  oould  help  the  Agenoy  to  improve  its  oapabilities.^^  The 
National  Imagery  and  Mapping  Agenoy  mission  is  “to  provide  timely, 
relevant,  and  aoourate  intelligenee  and  geospatial  information  in  support  of 

Ofi 

national  seourity  objeotives  of  the  United  States.” 

Organizational  Implementation 

In  addition  to  the  DOD  high  level  thinking  on  HSI  just  disoussed, 
various  ageneies  are  also  working  organizational  aspeots  to  try  to  take 
advantage  of  HSI  teohnologies,  even  if  most  of  the  antioipated 
teohnologies  do  not  yet  exist.  For  example,  the  Central  Measurement  and 
Signal  Intelligenee  (MASINT)  Organization  (CMO)  has  already  made 
signifioant  progress  by  providing  HSI  training  to  operators  as  well  as  by 
narrowing  the  searoh  for  the  appropriate  software  tools  to  enhanoe  the 
oapabilities  of  the  operators.  As  noted  earlier,  to  the  untrained  eye  HSI 
does  not  “look”  like  standard  imagery;  thus,  standard  imagery  analyst 
training  is  insuffioient  to  prepare  operators  for  this  new  field.  To 
overeome  some  of  the  human  and  teehnologieal  issues  already  identified, 
the  CMO  established  the  Hyperspeetral  MASINT  Support  to  Military 
Operations  (HYMSMO)  Program  Offiee  within  the  Speetral  Information 
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Technology  Applications  Center.  The  Center’s  mission  is  to  provide  key 
infrastructure  support  to  further  the  DOD’s  and  intelligence  community’s 
understanding  of  HSI  and  its  potential  utility.^^  To  fulfdl  the  HYMSMO 
program’s  mission  to  increase  understanding,  the  CMO  has  created  the 
Training  Education  Coordination  Office  to  obtain  the  proper  training  at  all 
levels  from  the  Spectral  Information  Technology  Applications  Center. 
Various  training  courses  exist  depending  on  the  levels  of  detail  needed. 
For  example,  one  course  gives  senior  leaders  a  broad  understanding  of 
what  HSI  brings  to  the  fight.  Other  courses  are  tailored  for  mid-level 
leaders  and  collection  managers.  Finally,  the  CMO  offers  a  very  detailed 
course  on  how  to  exploit  HSI  processing.  Currently  this  training  is 
contracted  out,  but  there  is  already  on-going  discussion  about  how  to  bring 
the  training  into  standard  military  intelligence  coursework.^^ 

The  services  are  also  playing  a  more  active  role  in  HSI.  For 
example,  the  Army  took  the  lead  within  the  former  U.S.  Space  Command, 
now  U.S.  Strategic  Command,  by  setting  up  the  Spectral  Operations 
Resource  Center.  This  center’s  primary  mission  is  to  coordinate  and 
manage  the  command’s  hyperspectral  and  multi-spectral  production 
capabilities  and  to  integrate  new  spectral  advances. It  achieves  this  goal 
by  providing  the  command  with  access  to  spectral  products  and  services 
while  advocating  new  spectral  requirements  to  support  the  warfighter. 
The  center  completes  the  cycle  by  staying  involved  in  various  activities  to 
bring  the  latest  in  spectral  technologies  and  capabilities  to  operational 
forces.  The  basic  idea  is  that  as  the  lead  HSI  servicer  for  U.S.  Strategic 
Command,  the  Spectral  Operations  Resource  Center  will  act  as  an  HSI 
clearinghouse  along  with  the  Naval  Space  Command’s  Remote  Earth 
Sensing  Information  Center  and  a  yet  to  be  decided  capability  within  Air 
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Force  Space  Command. 

As  just  noted,  the  Navy  performs  much  of  its  spectral  operations 
through  its  Remote  Earth  Sensing  Information  Center.  The  Navy  center 
has  the  ability  to  exploit  HSI  data  and  is  preparing  to  use  hypercubes 
provided  by  a  Navy  HSI  satellite  when  launched.  The  center  has 
primarily  been  involved  with  multi-spectral  imagery  and  has  provided 
spectral  support  to  Navy  and  Marine  forces  in  operations  spanning  the 
non-combat  to  combat  spectrum  for  over  a  decade.  This  support  takes 
many  forms  including  intelligence  preparation  of  the  battlefield,  mission 
planning,  order  of  battle,  and  change  detection  among  others. 

The  Air  Force  is  also  stepping  up  its  efforts  to  incorporate  HSI  into 
its  service  roles  and  missions.  The  leader  of  these  efforts  is  Air  Combat 
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Command’s  Air  Force  Command  and  Control  &  Intelligence, 
Surveillance,  and  Reconnaissance  Center  (AFC2ISRC),  which  has  created 
an  HSI  Integrated  Product  Team  (IPX)  to  bring  the  maximum  HSI  utility 
to  the  warfighter  via  “architectures,  roadmaps,  requirements  and 
standards. The  IPT  is  also  designed  to  maximize  Air  Force  efforts  in 
this  technology  while  minimizing  duplication  of  effort  with  the  other 
services.  It  would  seem  the  IPX’s  greatest  contribution  is  its  ability  to  be 
the  recognized  central  point  for  organizations  to  bring  HSI  issues  to  the 
Air  Force.  Major  projects  that  the  HSI  IPT  is  currently  working  on 
include  an  Air  Force  level  concept  of  operations  and  a  roadmap  for  the 
HSI  “Family  of  Systems. This  type  of  strategic  thinking  within  the 
service  is  needed  to  integrate  air  and  space  HSI  efforts  that  are  going  on  in 
various  portions  of  the  Air  Force.  A  recent  meeting  of  the  HSI  IPT  noted 
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the  need  to  ensure  Air  Force  Space  Command  is  brought  into  the  team. 
This  should  have  a  strong  positive  impact  on  the  service’s  implementation 
of  HSI  to  ensure  space  and  air  are  not  at  odds  with  each  other,  and  even 
more  importantly,  it  can  maximize  each  organization’s  strengths. 

As  if  to  highlight  the  admonition  from  the  AFC2ISRC’s  HSI  IPT, 
Air  Force  Space  Command  and  Air  Combat  Command  have  already 
started  to  build  a  roadmap  to  address  the  notional  requirements  for  a 
space-based  HSI  sensor  system.  The  “system”  concept  is  very  important 
because  HSI  is  not  merely  a  sensor;  it  is  only  one  part  of  a  much  larger 
series  of  interconnected  pieces  that  starts  with  a  warfighter  request  for 
information  and  concludes  when  the  warfighter  receives  the  requested 
information.  The  Air  Force  Space  Command/Air  Combat  Command  draft 
roadmap  for  a  space-based  system  recognizes  this  interconnectedness  and 
highlights  some  of  the  areas  that  must  be  addressed  in  whatever  final 
system  is  chosen.  The  draft  roadmap  also  highlights  the  need  to  leverage 
the  potential  of  other  military  and  civilian  spectral  programs. By  using 
this  leverage,  the  two  commands  can  do  much  to  lower  acquisition  and 
operational  risk.^^  The  roadmap  also  briefly  addresses  what  will  turn  out 
to  be  huge  issues  such  as  command  and  control  architectures,  sensor 
development,  data  processing  requirements,  and  how  the  information  is 
actually  passed  to  the  customer.  The  preceding  paragraphs  have  identified 
some  of  the  important  doctrinal  issues  relating  to  HSI  and  examined  the 
roles  and  functions  of  DOD  and  service  organizations.  The  discussion 
will  now  turn  to  a  review  of  actual  airborne  systems,  space-home  systems, 
and  ground  processing  systems  with  which  these  organizations  intend  to, 
or  already  have,  brought  HSI  to  life. 
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Military  Airborne  HSI  Systems 

The  Defense  Advaneed  Researeh  Projeets  Ageney  (DARPA)  is  a 
key  DOD  organization  that  is  devoting  mueh  effort  to  HSI,  and  it  eontrols 
the  first  HSI  airborne  sensor  reviewed  here.  DARPA  is  the  DOD’s 
primary  researeh  and  development  organization,  and  based  on  its  eharter, 
it  aetively  pursues  programs  that  are  high  risk  yet  earry  signifieant 
potential  to  produee  huge  payoffs  for  military  missions."^®  In  1998,  the 
Ageney  began  working  on  an  effort  ealled  the  Adaptive  Speetral 
Reeonnaissanee  Program  (ASRP).  The  main  goal  of  this  effort  is  to 
develop  hyperspeetral  technology  that  can  be  used  to  meet  some  of  the 
potential  missions  noted  earlier,  specifically  seeing  through  adversary 
camouflage,  concealment,  and  deception.'^'  ASRP  is  focused  on 
developing  the  technology  primarily  for  unmanned  airborne  systems,  and 
it  has  four  specific  “technology  thrusts”:  models  and  algorithms,  data 
analysis  and  signature  databases,  LWIR  (long-wavelength  infrared)  sensor 
development,  and  data  collections  and  demonstrations."^^  DARPA  would 
like  to  see  these  technology  thrusts  result  in  improved  tactical  intelligence 
productivity  through  the  use  of  advanced  processing  tools  for  better  target 
detection,  eventually  leading  to  higher  probability  of  kill  and  shortened 
time-lines  to  bring  the  needed  information  to  the  warfighter.  They  hope 
that  through  the  use  of  manned  and  unmanned  platforms,  ASRP  can  help 
successfully  resolve  nagging  issues  such  as  the  previously  noted 
camouflaged  vehicles  and  vehicles  hiding  in  shadows  or  in  tree  lines. 
These  were  particular  shortcomings  noted  from  Operation  Allied  Force  in 
Kosovo  in  1999."^^ 

Another  airborne  sensor  program  called  the  Hyperspeetral  Digital 
Imagery  Collection  Experiment  (HYDICE)  was  created  from  a  set  of 
Naval  Research  Eaboratory  requirements  and  has  been  flown  aboard  a 
Convair  580  and  a  C-141  aircraft  at  altitudes  up  to  40,000  feet.  The 
advanced  design  of  HYDICE  was  based  on  the  lessons  learned  in  the 
multi-spectral  imagery  arena,  and  the  system  has  become  very  useful  for 
assessing  the  utility  of  reflective  HSI.  It  collects  206  bands  of  spectral 
data  in  the  visible,  NIR  and  SWIR  (0.4-2. 5  pm,  overall).  The 
Hyperspeetral  MASINT  Support  to  Military  Operations  program  is  one 
effort  that  has  used  HYDICE  as  an  HSI  sensor  to  collect  data  on  several 
targets  in  a  variety  of  climatic  regions. 
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Military  Spaceborne  HSI  Systems 

One  success  story  that  recently  completed  its  scheduled  mission  is 
MightySat  II.  1,  the  Air  Force  Research  Laboratory’s  first  HSI  sensor  in 
space.  This  system  had  256  bands  covering  a  wavelength  range  from 
0.35-1.05  pm  with  a  spatial  resolution  of  1.7  nautical  miles."^^  As  part  of  a 
multi-satellite  program,  MightySat  II.  1  was  designed  to  give  the  Air  Force 
a  low-cost  platform  that  is  capable  of  demonstrating  high  risk  technologies 
for  the  purpose  of  accelerating  the  maturity  of  these  technologies."^^  The 
main  difference  between  MightySat’s  sensor  and  the  others  in  this  review 
is  the  method  used  to  gain  spectral  resolution.  While  other  sensors  use  a 
grating  to  spread  out  the  different  wavelength  photons,  MightySat  II.  1 
uses  interference  patterns  on  the  sensor  that  are  processed  to  produce  the 
required  spectral  results.  This  method  has  the  potential  to  work  very  well 
in  the  LWIR  band  where  it  achieves  the  combination  of  a  wider 
wavelength  band  and  smaller  spectral  resolution  (as  low  as  six 
nanometers)  than  other  types  of  sensors."^’  Because  this  spectral  resolution 
is  smaller,  it  has  the  potential  to  provide  a  better  spectral  signature  for 
items  under  surveillance.  One  could  say  the  “fingerprint”  of  the  items  is 
more  precise,  enhancing  our  ability  to  better  distinguish  between  items 
that  are  similar  to  one  another. 

Following  MightySat  II.  1,  military  spaceborne  HSI  success  stories 
are  harder  to  come  by.  The  plan  was  to  follow  up  the  MightySat 
demonstrator  with  a  much  more  capable  system  called  Warfighter- 1.  The 
Air  Force  Research  Laboratory  partnered  with  ORB  IMAGE  Corporation 
to  fly  this  sensor  aboard  the  commercial  OrbView-4  satellite.  To  enhance 
the  sensing  capabilities  of  the  satellite,  it  was  designed  to  be  able  to 
simultaneously  image  a  region  using  panchromatic  and  multi-spectral 
imagery  techniques  in  addition  to  HSI.  Its  HSI  capabilities  were  to 
acquire  spectral  images  from  .45-2.45  pm  in  bands  about  .01  pm  in  width 
with  a  resolution  of  eight  meters  and  having  a  swath  width  of  five 
kilometers."^*  Key  objectives  of  Warfighter-1  were  to,  first,  continue  to 
demonstrate  the  technology  and  second,  to  validate  the  capabilities  of  the 
system  needed  to  produce  information  useful  to  a  Joint  Force 
Commander."^^  Unfortunately,  on  21  September  2001,  Warfighter- I’s 
Taurus  launch  vehicle  failed  about  two  minutes  into  launch  and 
Warfighter- 1  was  lost.^°  Though  this  was  a  very  discouraging 
development,  the  Air  Force  Research  Laboratory  has  been  quick  to 
promote  the  idea  of  another  follow  on  sensor  with  even  greater  capabilities 
than  Warfighter-1  called  Noble  EYE  (for  Enhanced  Hyperspectral 
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Experiment).  This  sensor  will  have  the  capability  to  view  a  twenty- 
kilometer  swath  width  with  a  spatial  resolution  as  low  as  four  to  five 
meters.  The  laboratory  is  currently  working  with  the  National  Aeronautics 
and  Space  Administration  and  the  Jet  Propulsion  Laboratory  to  design  and 
build  the  satellite  bus  and  sensor  for  a  possible  launch  in  the  2005 
timeframe.  Expected  costs,  including  launch,  are  currently  in  the  $200 
million  range.  Naturally,  convincing  the  holders  of  the  necessary  funds  to 
release  the  resources  is  a  large  step.  The  plan  is  now  being  proposed  to 
the  Under  Secretary  of  the  Air  Eorce,  the  single  overseer  of  space 
acquisition  projects. 

Of  the  other  services,  the  Navy  is  the  closest  to  putting  the  next 
hyperspectral  sensor  into  orbit.  The  Naval  EarthMap  Observer  (NEMO) 
is  being  built  to  provide  unclassified  thirty-meter  hyperspectral  resolution 
for  use  primarily  by  naval  forces  and  the  civil  sector.  It  has  a  designed 
mission  life  of  five  years  over  which  it  will  map  large  portions  of  the 
Earth’s  surface,  focusing  on  littoral  regions.  It  will  also  be  able  to  have 
repeat  coverage  over  several  of  these  areas  to  allow  for  processing 
algorithm  validation  and  improvement.  Its  HSI  sensor  has  a  range  from 
.4-2.5  pm  broken  into  210  spectral  bands  that  are  .01  pm  wide.  NEMO 
also  carries  a  panchromatic  camera  that  can  be  used  simultaneously  with 
the  HSI  sensor  to  provide  fuller  characterization  of  the  scene.  Key  uses 
for  the  Naval  EarthMap  Observer  are  expected  to  include  studies  of  utility 
for  preparing  and  understanding  of  the  area  for  amphibious  assault,  water 
clarity,  underwater  hazards,  beach  characterization,  and  runoff  effects 
among  others. 

One  area  in  which  the  Naval  EarthMap  Observer  is  expected  to 
make  huge  strides  is  in  on-board  processing.  As  discussed  earlier,  the  size 
of  a  hypercube  will  be  an  issue  when  it  comes  to  transmitting  the 
hypercube  to  the  user;  one  source  envisions  raw  data  rates  one  day  as  high 
as  50  Gigabits/sec. Even  the  NEMO’s  own  high  band  data  rate  is  only 
150  Mbps.  It  would  appear  that  much  on-board  processing  is  necessary  to 
extract  only  the  needed  data  from  the  hypercube.  In  fact,  the  Navy 
Research  Laboratory  is  attempting  to  work  such  an  issue  with  its  Optical 
Real-Time  Adaptive  Signature  Identification  System.  This  patented 
system  is  designed  to  “significantly  reduce  the  amount  of  data  that  NEMO 
must  transmit  to  the  ground  while  preserving  97  to  98  percent  of  the  data 
fidelity. The  system  can  recognize  and  eliminate  duplicate  spectra  from 
a  scene,  it  can  recognize  important  spectra  that  need  to  be  transmitted  to 
the  ground,  and  it  has  already  been  successfully  proven  aboard  airborne 
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vehicles.  Another  key  aspect  of  the  system  is  that  it  provides  “greater  than 
ten-fold  data  compression,  relieving  the  bottlenecks  of  on-board  data 
storage  and  transmission  to  the  ground. 

As  of  the  writing  of  this  paper,  the  biggest  problem  facing  the 
Naval  EarthMap  Observer  is  money.  The  satellite’s  production  is 
currently  stalled  because  of  the  manner  in  which  the  program  is  funded. 
The  satellite  was  to  be  built  using  a  50-50  split  of  government  and 
commercial  funds.  However,  the  commercial  partner  has  run  out  of  funds 
and  the  Naval  EarthMap  Observer  is  on  hold  while  further  financing  is 
procured. It  currently  has  no  launch  date,  but  the  delay  is  expected  to  be 
at  least  two  years. This  brief  review  of  military  systems  is  now 
complete,  but  the  military  is  not  the  only  organization  interested  in  HSI 
technology  and  its  potential  applications. 

Non-Military  US  Government  HSI  Systems 

One  government  organization  that  is  devoting  much  effort  to  HSI 
is  the  National  Aeronautics  and  Space  Administration  (NASA).  They 
have  an  airborne  sensor  called  the  Airborne  Visible/Infrared  Imaging 
Spectrometer,  or  AVIRIS.  AVIRIS  has  224  bands  in  the  spectral  region 
from  .38-2.5  pm,  a  .01  pm  bandwidth,  and  20-meter  spatial  resolution, 
and  it  flies  aboard  a  modified  U-2  aircraft.  On  a  large  scale,  the 
spectrometer  is  used  primarily  to  sense  the  makeup  of  the  Earth’s  surface 
as  well  as  the  atmosphere.  Investigations  using  the  spectrometer  are 
typically  focused  on  climate  change  and  the  global  environment.^^  The 
spectrometer  has  been  used  to  study  coastal  water  flows,  snow,  and  forest 
damage. 

NASA  has  also  moved  HSI  into  the  spaceborne  realm  with  their 
Earth  Observing- 1  satellite,  which  carries  the  TRW-developed  Hyperion 
HSI  sensor.  Hyperion  has  220  spectral  bands  in  the  .4-2.5  pm  bandwidth 
with  thirty-meter  resolution.  The  satellite  has  been  inserted  in  an  orbit 
where  it  will  sense  the  same  scene  as  the  US  Geological  Survey’s  Eandsat 
7  satellite,  which  is  capable  of  multi-spectral  imagery.  In  so  doing, 
scientists  and  engineers  hope  to  validate  data  from  the  Hyperion’s  sensors 
and  add  to  the  research  knowledge  base.^^ 

Hyperion’s  sensor  package  is  not  designed  to  provide  real-time  or 
even  near  real-time  data.  This  is  because  its  three  sensors  will  need  to 
transmit  20  gigabits  of  data  to  the  ground.  This  huge  amount  of  data  must 
then  be  stored  on  digital  tapes  that  are  mailed  to  the  appropriate 
organizations  for  processing. This  timetable  is  sufficient  for  civil 
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purposes  and  perhaps  to  assist  the  military,  espeeially  for  long-term 
strategie  purposes.  Unfortunately,  the  system  will  not  be  nearly  fast 
enough  for  military  use  inside  a  Joint  Foree  Commander’s  eampaign 
plan.  Interestingly,  one  report  indieates  the  Hyperion  sensor  was  used 
over  Afghanistan  to  give  researehers  “a  unique  opportunity  to  eompare 
hyperspeetral  images  of  targets  before  and  after  they  were  bombed,  adding 
to  the  store  of  signature  data  that  can  be  used  in  applying  the  technology  to 
targeting  and  post- attack  damage  assessment. 

The  next  two  government  sensors  to  be  discussed  are  not 
hyperspeetral,  but  are  actually  multi-spectral  imagery  sensors  that 
demonstrate  the  value  that  multiple  spectra  viewers  can  have  over  and 
above  panchromatic  sensors.  The  first  of  these  is  the  Landsat  satellite  run 
by  the  Department  of  the  Interior’s  US  Geological  Survey.  The  most 
recent  of  the  Landsat  series  is  Landsat  7,  which  is  used  to  acquire  multi- 
spectral  images  of  the  Earth's  land  surface  and  coastal  regions. Landsat 
7  flies  over  the  entire  globe  every  16  days  and  can  sense  objects  as  small 
as  thirty  meters,  much  like  capabilities  of  the  Navy’s  Naval  EarthMap 
Observer  satellite. Eandsat  7’s  sensor  collects  visible  and  infrared 
photons  in  eight  different  spectral  bands.  These  include  four  visible  and 
near  infrared  bands  from  .4-1.0  pm,  two  bands  in  the  short  wavelength 
infrared  from  1. 0-3.0  pm,  and  one  band  in  the  emissive  medium 
wavelength  infrared  band  from  8.0-12.0  pm.  The  satellite  should  be  able 

to  provide  scientists  with  unprecedented  quantity  and  quality  views  of 
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changes  across  the  terrestrial  environment  (e.g.,  seasonal  changes). 

The  Department  of  Energy’s  Office  of  Nonproliferation  and 
National  Security  has  also  orbited  its  own  multi-spectral  imagery  satellite. 
The  Multispectral  Thermal  Imager  was  launched  on  12  Mar  2000,  and  has 
as  the  primary  objective  of  demonstrating  “advanced  multi-spectral  and 
thermal  imaging,  image  processing,  and  associated  technologies  that  could 
be  used  in  future  systems  for  detecting  and  characterizing  facilities 
producing  weapons  of  mass  destruction.”*’^  The  system  has  15  discrete 
spectral  bands  from  the  visible  to  the  long  wavelength  infrared.  In  the 
visible  spectrum  it  has  five-meter  resolution;  in  the  infrared  the  resolution 
is  as  low  as  20  meters.’** 

US  Non-governmental  HSI  System 

US  non-govemmental  organizations  are  also  playing  a  role  in  HSI. 
In  addition  to  the  cooperative  ORBIMAGE/USAE  Warfighter- 1  noted 
earlier,  the  Aerospace  Corporation  has  created  an  airborne  sensor  called 
the  Spectrally  Enhanced  Broadband  Array  Spectrograph  System 
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(SEBASS).  This  HSI  sensor  is  flown  in  the  Central  MASINT 
Organization’s  Hyperspeetral  MASINT  Support  to  Military  Operations 
projeet  as  well  as  in  non-military  projeetsJ^  A  key  aspeet  of  the  SEBASS 
system  is  that  like  the  multi-speetral  imagery  sensors  aboard  Eandsat  7 
and  the  Multispeetral  Thermal  Imager,  and  unlike  the  bulk  of  other  HSI 
sensors,  this  system  measures  in  the  emissive  speetral  region.  More 
specifieally,  it  senses  in  two  long  wavelength  infrared  bands,  2.42-5.33 
pm  and  7.57-13.52  pm.  Again,  the  long  wavelength  infrared  aspect  of 
the  SEBASS  gives  it  both  a  daylight  and  nighttime  capability. 

Non-US  HSI  Systems 

Non-US  organizations  are  also  playing  a  larger  role  in  HIS.  In  the 
space  arena,  by  2005,  an  HIS  sensor  on  the  Australian  Resource 
Information  and  Environment  Satellite  will  image  across  105  channels  in 
the  range  .4-2.5  pm  split  between  one  visible  and  two  short  wave  infrared 
sensor  arrays.  The  spatial  resolution  of  the  sensor  will  only  be  30  meters, 
but  as  with  other  sensors  reviewed  earlier,  a  ten-meter  resolution 
panchromatic  sensor  will  be  used  simultaneously  to  produce  composite 
images.  These  uses  for  these  images  will  include  geological  mapping, 
mineral  exploration,  environmental  monitoring,  forestry,  and  crop  yield 
assessment.  Canada  has  also  Added  an  HSI  platform,  theirs  being  an 
airborne  system  called  the  Compact  Airborne  Spectrographic  Imager 
(CASI)-2.  Eike  many  other  HSI  systems,  it  is  used  to  conduct  research  in 
agriculture,  environmental  studies,  water  quality,  and  forestry.  Though  it 
doesn’t  possess  the  wide  wavelength  band  of  many  of  the  HSI  sensors 
reviewed  above,  it  is  still  capable  of  recording  spectral  data  from  .4-1.0 
pm.  This  range  is  can  be  divided  into  a  maximum  of  288  bands,  and 
depending  on  the  altitude  of  the  aircraft;  the  resolution  can  be  between 
0.6-10  meters. 

Having  reviewed  several  of  the  major  HIS  and  multi-spectral 
sensor  systems  from  military,  U.S.  and  non-U.  S.  governmental,  and 
commercial  areas,  our  attention  now  focuses  on  an  issue  that  is  just  as 
critical  as  the  sensor — ground  processing.  Just  as  the  onboard  processing 
system  Optical  Real-Time  Adaptive  Signature  Identification  System  is 
critically  important  to  the  success  of  the  Navy’s  Naval  EarthMap  Observer 
satellite,  so  too  will  the  ground  processing  be  vital  to  any  HSI  system  that 
is  used  to  support  a  military  campaign. 
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HSI  Ground  Processing 

Although  there  is  no  single  lead  for  the  hyperspeetral  sensors 
themselves,  the  ground  proeessing  portion  of  the  overall  system  is  being 
worked  at  a  much  more  integrated  level,  with  results  that  it  should  prove 
far  more  interoperable  than  other  military  systems.  The  overarching 
ground  processing  system  that  will  incorporate  and  process  the  data  from 
HSI  platforms  is  called  the  DOD  Distributed  Common  Ground  System,  or 
DCGS.  The  DCGS  is  really  a  family  of  systems  employed  by  each  service 
to  exploit  the  huge  amounts  of  intelligence,  surveillance,  and 
reconnaissance  (ISR)  data  produced  by  a  wide  array  of  sensors.  Current 
planning  appropriately  places  HSI  processing  within  the  DCGS  along  with 
other  types  of  intelligence  data  processing. 

Key  concepts  regarding  the  Distributed  Common  Ground  System 
are  being  captured  in  a  much  needed  capstone  requirements  document. 
This  document  plainly  lays  out  the  needs  and  the  requirements  for  all  the 
services’  systems  within  the  overall  DCGS  to  interoperate  with  each  other 
to  ensure  that  field  commanders  do  in  fact  achieve  decision  superiority.^^ 
In  addition  to  merely  stating  that  the  systems  need  to  be  interoperable,  the 
document  dictates  that  this  family  of  systems  must  work  together  with 
surface,  airborne  and  spaceborne  assets.  This  integration  will  allow  the 
DCGS  to  assist  a  Joint  Force  Commander  across  the  entire  spectrum  of 
conflict,  in  particular  during  combat,  but  in  all  aspects  of  campaign 
planning,  execution  and  assessment  as  well.^^ 

As  an  example  from  just  one  service,  within  the  DOD  DCGS 
structure,  the  Air  Force  has  a  program  (the  Distribution  Common  Ground 
Station)  that  ahempts  to  address  shortfalls  in  the  ISR  arena.  The  service  is 
currently  circulating  a  draft  plan  to  list  many  of  the  needed  attributes  of 
the  Air  Force  portion  of  the  DOD  structure.  According  to  this  document 
the  Air  Force  intends  to  use  their  system  to  allocate  what  is  known  as 
“multi-INT”  responsibilities  across  the  service’s  intelligence  organizations 
to  take  full  advantage  of  information  collected  by  the  entire  intelligence 
community.  The  key  thought  here  is  that  the  Air  Force  system  will 
eliminate  many  current  systems  that  are  often  proprietary  or  can  operate 
with  only  one  type  of  intelligence.^^  The  Air  Force  ground  station 
components  are  designed  to  be  either  fixed  or  deployable,  and  they  will  be 
capable  of  connecting  to  a  secure  Wide  Area  Network  that  will  allow  the 
multi-INT  concept  to  work.  The  stations  will  possess  tremendous 
processing  capability,  but  it  is  expected  that  it  could  still  take  up  to  four 
hours  to  process  a  full  hypercube.  The  standard  hypercube  is  defined  as 
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less  than  or  equal  to  1024  pixels  by  1024  pixels  by  318  bands,  or  at  least 
333  million  total  pixels.  However,  hypereubes  may  get  as  large  as  2048 
pixels  by  4096  pixels  by  512  bands,  or  more  than  four  billion  pixels  before 
FY05.  Reeognizing  that  the  warfighter  may  not  be  willing  to  wait  up  to 
four  hours  for  information,  the  AF  also  proposes  that  their  station  be  able 
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to  proeess  a  subset  of  the  hypereube,  ealled  a  “ehip,”  within  20  minutes. 
Given  the  size  of  hypereubes,  their  analysis  is  typieally  very  proeessing 
intensive,  whieh  is  one  reason  why  HSI  has  taken  so  long  to  eome  of  age. 
It  is  interesting  to  note  that  joint  doetrine  from  as  reeently  as  1996  notes 
that  neither  Joint  Foree  Commander’s  own  intelligenee  eenter,  nor  the 
eommand’s  subordinate  eenters,  has  the  eapability  for  MASINT 
proeessing.  Mueh  progress  has  oeeurred  in  the  past  six  years  and  this  is 
no  longer  true.  As  a  result  of  this  progress,  the  intelligenee  eommunity  is 
at  the  eusp  of  being  able  to  use  HSI  for  direet  warfighter  support. 

As  noted  earlier,  within  any  ground  station  program  one  must 
eonsider  the  software  used  to  aetually  proeess  the  data.  The  MASINT 
eommunity  seems  to  have  settled  on  two  systems  for  development.  The 
National  Air  Intelligenee  Center  (NAIC)  is  developing  proeessing 
software  ealled  Common  Speetral  MASINT  Exploitation  Capability  that  is 
used  to  help  the  intelligenee  analyst  interpret  HSI  data.  The  NAIC 
software  was  designed  from  the  start  to  ensure  its  algorithms  were  not 
limited  to  one  layer  of  data,  but  instead  eould  proeess  multiple  layers  of 
data  sueh  as  hypereubes.  The  software  is  noted  for  aiding  in  defeating 
eamoufiage,  eoneealment,  and  deeeption  and  is  known  for  its  ease  of 
use.  The  software  eurrently  is  used  in  several  HSI  applieations  to 
inelude  intelligenee  preparation  of  the  battlefield,  eamoufiage  ID, 
targeting  support,  ehange  deteetion,  and  seareh  and  reseue.  The  software 
developers  hope  to  soon  add  other  features  to  support  faeility 
eharaeterization,  treaty  monitoring,  and  the  seareh  for  weapons  of  mass 
destruetion.  The  seeond  primary  software  tool  under  eonsideration  is 
ealled  Environment  for  Visualizing  Imaging,  or  ENVI.  A  leading 
eommereial  produet  developed  by  Kodak’s  Researeh  Systems,  Ine.,  ENVI 
has  eapabilities  to  support  both  airborne  and  spaeeborne  sensors  by 
enabling  terrain  analysis,  radar  analysis,  and  more.  Just  as  several  of  the 
platforms  diseussed  earlier  eombined  standard  imaging  sensors  with  HSI 
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systems,  so  too  does  ENVI  eombine  image  proeessing  and  speetral  tools. 

The  preeeding  diseussion  of  the  eurrent  status  of  hyperspeetral 
imagery  systems  highlights  the  faet  that  while  eommereial  applieations 
abound  for  HSI,  it  has  still  not  arrived  as  a  major  player  within  the 
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military  intelligence  community.  On  the  other  hand,  based  on  the  wording 
in  the  U.S.  Senate  language,  there  is  still  a  great  deal  of  interest  in  what 
HSI  can  eventually  bring  to  the  warfighter.  The  next  section  of  the  paper 
will  examine  some  of  the  roadblocks  that  are  hampering  the  effort  to  fully 
incorporate  a  robust  HSI  capability  for  the  U.S.  military. 
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III.  Challenges:  Vision,  Doctrine,  and  the  Intelligence 
Cycle 

This  section  of  the  paper  will  review  where  HSI  fits  into  the 
Chairman  of  the  Joint  Chiefs  of  Staff  vision  for  where  the  military  ought 
to  be  in  20  years.  This  discussion  will  be  followed  by  a  lengthier 
introduction  of  the  intelligence  community  and  some  first  guesses  as  to 
where  HSI  should  fit.^"^ 

“Fit”  into  Joint  Vision  2020 

The  armed  forces  of  the  United  States  must  be  capable  of  helping 
the  nation  achieve  its  goals  across  the  entire  spectrum  of  military 
operations.  Forces  must  be  organized,  trained,  and  equipped  to  create  the 
necessary  conditions  for  successful  missions  across  the  continuum  from 
non-combat  operations  (e.g.,  humanitarian  operations)  all  the  way  up  to 
large-scale  combat  operations. The  Chairman,  Joint  Chiefs  of  Staff 
published  “Joint  Vision  2020”  (JV  2020)  as  a  roadmap  to  help  guide  the 
transformation  of  the  military  into  such  a  force.  Though  HSI  is  not  touted 
as  a  complete  solution  to  the  idea  of  transformation  for  information 
dominance,  it  can  certainly  play  a  role  in  the  Chairman’s  vision.  The  idea 
of  “full  spectrum  dominance”  is  preeminent  in  the  vision.  As  stated  in  JV 
2020,  this  dominance  is  “the  ability  of  US  forces,  operating  unilaterally  or 
in  combination  with  multinational  and  interagency  partners,  to  defeat  any 
adversary  and  control  any  situation  across  the  full  range  of  military 
operations.  Achieving  full  spectrum  dominance  means  the  joint  force  will 
fulfill  its  primary  purpose — victory  in  war — as  well  as  achieving  success 
across  the  full  range  of  operations. 

The  Chairman  went  on  to  discuss  that  the  key  enabler  for  the  future 
force  to  achieve  full  spectrum  dominance  lies  in  the  area  of  information 

superiority  or,  “the  degree  of  dominance  in  the  information  domain 
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which  permits  the  conduct  of  operations  without  effective  opposition.” 
JV  2020  goes  further  to  say  that  information  superiority  is  not  sufficient, 
but  in  fact,  superior  information  must  be  converted  into  truly  superior 
knowledge  to  achieve  superiority  in  decision-making.  The  Chairman  was 
quick  to  point  out  that  decision  superiority  is  not  an  automatic  outcome  of 
information  superiority,  but  in  fact  it  requires  a  foundation  composed  of 
sound  organization  and  doctrine,  thorough  training  combined  with 
experience,  and  the  right  tools.  This  paper  proposes  that  HSI  is  one  of 
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the  “right  tools”  necessary  to  achieve  information  superiority  to  offer  hope 
for  decision  superiority. 

The  Chairman  did  offer  an  admonition,  however,  in  the  area  of 
improving  technology,  and  it  is  one  that  should  be  taken  seriously  and 
applied  to  HSI.  He  noted  that  it  is  important  to  not  merely  focus  on  new 
technology,  but  to  look  beyond  the  technology  to  understand  the 
importance  of  organizing  properly  and  to  grasp  the  need  for  conceptual 
innovation.  Technology  can  be  very  useful,  but  it  needs  to  be  integrated 
with  changes  in  doctrine,  organization,  training,  materiel,  leadership  and 
education,  personnel,  and  facilities. 

Another  concept  relating  HSI  to  JV  2020  is  precision  engagement. 
Precision  engagement  is  one  of  the  four  pillars  supporting  full  spectrum 
dominance,  and  it  is  the  one  most  closely  aligned  to  HSI.^^  Precision 
engagement  is  defined  as,  “the  ability  of  joint  forces  to  locate,  surveil, 
discern,  and  track  objectives  or  targets;  select,  organize,  and  use  the 
correct  systems;  generate  desired  effects;  assess  results;  and  reengage  with 
decisive  speed  and  overwhelming  operational  tempo  as  required, 
throughout  the  full  range  of  military  operations.”  The  potential  of  HSI 
lies  within  its  ability  to  affect  target  selection  and  assess  results.  Yet  HSI 
cannot  fulfill  the  vision  of  precision  engagement  alone.  The  most 
important  trait  of  precision  engagement  is  the  “family”  of  sensors,  weapon 
systems,  and  desired  effects.  It  is  in  this  context  that  HSI  is  not  a  stand¬ 
alone  technology;  it  is  part  of  a  larger  system  that  leads  to  the  final 
thoughts  from  JV  2020.^^ 

An  idea  that  is  consistent  with  the  preceding  discussion  and  has 
also  permeated  military  thought  since  Desert  Storm  is  that  of 
interoperability.  Essentially,  interoperability  is  the  ability  for  systems  to 
share  information.^"^  JV  2020  is  quick  to  point  out  that  there  is  much  more 
to  interoperability  than  merely  sharing  data  in  the  technical  realm  (e.g., 
bits  and  bytes).  In  fact,  the  document  exhorts  the  services  to  focus  on 
interoperability  of  procedures  and  organizations  as  well  as  on  gaining 
knowledge  of  one  another’s  capabilities  and  limitations.^^  Though  the 
results  of  Desert  Storm  (e.g.,  difficulty  getting  the  daily  Air  Tasking  Order 
to  all  units)  have  led  the  military  to  be  much  more  adept  at  meeting  the 
technical  requirements  of  interoperability,  the  DOD  must  also  be  on  guard 
to  ensure  the  implementation  of  this  new  technology  keeps  these  other 
types  of  interoperability  in  mind  as  well. 
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“Fit”  Into  Intelligence  World 

Current  joint  doctrine  separates  intelligence  sources  into  seven 
types  of  disciplines,  or  “INIs:”  Technical  Intelligence;  Signals 
Intelligence  (SIGINT);  Human  Intelligence  (HUMINT);  Open-source 
Intelligence  (OSINT);  Imagery  Intelligence  (IMINT);  Measurements  and 
Signals  Intelligence  (MASINT);  and  Counter-Intelligence.^^  Of  particular 
interest  for  this  paper  is  whether  HSI  can  best  be  described  as  IMINT  or 
MASINT.  The  distinction  here  may  be  subtle,  but  it  is  important 
nevertheless.  It  is  likely  that  the  owner  of  the  “INT”  will  get  not  only  the 
funding  but  also  the  personnel  to  implement  the  new  technology  (or, 
alternatively,  the  owner  will  be  tasked  to  take  them  out  of  hide).  It  is 
reasonable  to  assume  the  organization  that  receives  the  funding  to 
implement  HSI  carries  with  it  a  certain  culture  and  mindset.  For  instance, 
where  will  HSI  be  placed  in  the  priority  scheme  of  the  IMINT  or 
MASINT  communities?  Is  it  really  a  priority  or  merely  an  additional 
source  of  funding  for  other  higher  priority  systems  within  that 
organization?  Equally  important  to  decide  is  the  key  question,  “Who  is  in 
charge?”  Definitions  of  each  of  these  two  intelligence  techniques  are  a 
helpful  guide  to  highlight  where  controversy  in  the  intelligence 
community  may  arise.  IMINT  is  defined  as,  “Intelligence  derived  from 
the  exploitation  of  collection  by  visual  photography,  infrared  sensors, 
lasers,  electro-optics,  and  radar  sensors,  such  as  synthetic  aperture  radar, 
wherein  images  of  objects  are  reproduced  optically  or  electronically  on 
film,  electronic  display  devices,  or  other  media.”  Because  the  definition 
of  IMINT  includes  data  from  both  “visual”  and  “infrared”  systems,  a 
plausible  case  can  be  made  that  HSI  is  an  IMINT  technology.  While  HSI 
products  are  often  not  direct  representations  of  the  area  of  interest  that  are 
easily  recognizable  to  the  human  eye  (as  was  clearly  seen  in  earlier 
figures),  certainly  the  wavelength  bands  used  for  HSI  fall  within  the 
definition  if  IMINT.  Still,  others  believe  that  HSI  falls  within  the  purview 
of  the  MASINT  community.  Joint  Publication  2.0  defines  MASINT  in  the 
following  way: 

Intelligence  obtained  by  quantitative  and  qualitative 
analysis  of  data  (metric,  angle,  spatial,  wavelength,  time 
dependence,  modulation...)  derived  from  specific  technical 
sensors  for  the  purpose  of  identifying  any  distinctive 
features  associated  with  the  emitter  or  sender,  and  to 
facilitate  subsequent  identification  and/or  measurement  of 
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the  same.  The  detected  feature  may  be  either  reflected  or 

emitted.^* 

Again,  the  reader  can  see  the  ambiguity  between  the  definitions  of  the  two 
types  of  intelligence  with  respect  to  HSI  technology. 

This  paper  asserts  that  HSI  is  part  of  MASINT,  but  the  reasoning 
for  this  assertion  is  qualitative  rather  than  quantitative.  While  HSI 
certainly  uses  the  tools  of  IMINT,  such  as  the  visual  and  infrared 
spectrum,  strictly  categorizing  HSI  as  IMINT  severely  limits  the  perceived 
usefulness  of  this  technology.  If  an  analogy  can  be  drawn  between  types 
of  intelligence  and  the  senses  of  the  human  body,  IMINT  can  be 
associated  with  seeing  with  the  eyes  and  SIGINT  with  hearing  with  the 
ears.  MASINT,  on  the  other  hand,  with  HSI  as  one  of  its  components,  can 
be  considered  a  discipline  that  uses  all  the  senses. Because  HSI  uses 
many  wavelengths,  does  in  fact  have  spatial  resolution  aspects,  and 
certainly  facilitates  identification  of  items  within  the  field  of  view,  an  even 
stronger  case  can  be  made  that  HSI  is  actually  a  MASINT  technology. 
MASINT  proponents  as  well  as  the  preponderance  of  available  literature 
suggest  HSI  should  be  overseen  by  an  organization  responsible  for 
exploiting  these  types  of  data,  yet  with  significant  input  from  the  IMINT 
community. 

Current  Joint  Doctrine  Perspective 

Having  established  that  HSI  clearly  has  a  role  in  the  intelligence 
arena,  this  portion  of  the  paper  will  use  current  joint  doctrine  to  show  how 
the  Joint  Force  Commander  could  best  use  available  processes  to  exploit 
HSI.  This  part  of  the  paper  also  demonstrates  that  current  intelligence 
doctrine  is  not  in  bad  shape,  but  some  accommodation  for  HSI  is 
necessary.  For  instance,  existing  doctrine  discusses  how  intelligence 
agencies  are  arranged  to  support  a  Joint  Force  Commander,  yet  this 
discussion  shows  there  are  some  holes  regarding  where  HSI  fits  into 
intelligence,  who  is  in  charge  of  HSI,  the  resulting  lack  of  “ownership” 
when  it  comes  to  funding,  and  technical  issues  that  need  to  be  resolved 
(such  as  interoperability  and  standardized  databases)  to  take  full  advantage 
of  what  HSI  has  to  offer. 

According  to  joint  doctrine,  a  broad  network  of  intelligence 
organizations  supports  the  Joint  Force  Commander.  The  support  may 
come  from  the  commander’s  own  organic  intelligence  organization  or 
from  national  level  capabilities.  The  most  important  roles  of  these 
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organizations  are  to  help  the  commander  and  his  supporting  staff  to 
understand  the  battlespace  they  are  facing,  to  appraise  the  capabilities  and 
will  of  the  opponent,  to  identify  the  enemy’s  key  areas  of  strength  and 
power,  and  to  try  to  determine  the  enemy’s  intent.  Therefore,  a  key  role 
for  the  commander  is  to  ensure  the  intelligence  networks  are  brought  fully 
into  the  campaign  plan.^°*’ 

According  to  doctrine,  organic  support  takes  form  in  the 
commander’s  own  intelligence  staff  as  well  as  the  command’s  Joint 
Intelligence  Center,  or  in  the  case  of  a  Joint  Task  Force,  the  support  of  a 
Joint  Intelligence  Support  Element.  The  commander’s  intelligence  staff 
provides  the  strategic  lynchpin  for  many  aspects  of  intelligence  support  to 
the  campaign.  Some  of  the  functions  of  the  staff  include  ensuring 
intelligence  and  operations  are  synchronized,  developing  detailed 
intelligence  plans,  establishing  the  command’s  intelligence  architecture, 
and  integrating  national  and  theater  intelligence  support.  The  intelligence 
staff  coordinates  both  up  the  chain  (e.g.,  with  the  National  Military  Joint 
Intelligence  Center)  as  well  as  with  subordinate  agencies  (the 
commander’s  Joint  Intelligence  Center  and  component  agencies)  to  ensure 
the  commander  is  provided  with  well  integrated,  all  source  information. 
In  times  of  crisis  a  Joint  Force  Commander  may  also  stand  up  a  Joint 
Intelligence  Support  Element  to  augment  the  commander’s  intelligence 
staff.  The  intelligence  staff  directs  the  Joint  Intelligence  Support  Element 
efforts  that  would  usually  consist  of  collection,  production,  and 
dissemination  of  intelligence  for  the  joint  force. 

If  the  intelligence  staff  provides  the  strategic  intelligence  effort, 

then  the  command’s  Joint  Intelligence  Center,  or  JIC,  is  the  combatant 

commander’s  primary  source  of  intelligence  at  the  operational  and  tactical 

levels  of  war.  The  JIC  brings  together  the  supporting  services’  capabilities 

into  a  central  location  to  enhance  intelligence  support.  The  JIC  is  not 

expected  to  fulfdl  every  request  for  support,  but  it  is  designed  to  maximize 

the  ability  to  fill  requests  by  coordinating  support  from  all  echelons  of 

organization:  higher,  lower,  and  peer.  To  complete  its  duties,  the  JIC 

carries  out  many  functions  that  not  only  have  clear  implications  to  HSI  but 

also  apply  generically  to  all  types  of  intelligence  collection  as  well.  These 

functions  include  coordinating  intelligence  efforts  of  subordinate 

commands,  coordinating  the  use  of  sensors  assigned  to  the  theater  as  well 

as  supporting  sensors,  and  validating  Battle  Damage  Assessments  from 

1 02 

whichever  source  (e.g.,  national,  organic)  that  provides  it. 
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At  the  national  level,  the  Joint  Force  Commander  has  access  to  key 
organizations  that  are  designed  to  support  the  campaign.  While  there  are 
many  intelligence  players  at  the  national  level,  this  paper  will  focus  only 
on  those  most  closely  related  to  HSI.  These  are  Defense  Intelligence 
Agency,  the  Joint  Staff  Directorate  for  Intelligence,  the  National  Military 
Joint  Intelligence  Center,  the  National  Imagery  and  Mapping  Agency,  the 
National  Reconnaissance  Office,  and  the  Central  MASINT  Organization. 
These  will  likely  be  the  key  organizations  in  the  debate  and  resolution  on 
how  HSI  is  eventually  implemented.  A  brief  description  of  each  of  these 
organizations  is  included  below. 

The  Defense  Intelligence  Agency  (DIA)  has  the  responsibility  to 
plan,  direct,  collect,  process,  exploit,  analyze,  produce  disseminate, 
integrate,  and  evaluate  all-source  intelligence  for  the  DOD.'^*^  In  this  role, 
the  Agency  is  the  peacetime  focal  point  for  the  Joint  Force  Commander’s 
JIC  to  request  and  receive  intelligence  information  gathered  by  not  only 
this  agency  but  the  other  intelligence  organizations  as  well.^°"^  Thus,  to  the 
best  of  its  ability,  the  JIC  is  responsible  for  reviewing,  validating,  and 
acting  upon  intelligence  requests  from  the  command.  Then,  if  organic 
resources  are  not  available,  the  JIC  would  make  the  intelligence  request  to 
DIA.^“ 

The  Joint  Staff  Intelligence  Directorate  provides  all-source 
intelligence  to  many  customers  including  the  Chairman  of  the  Joint  Chiefs 
of  Staff,  the  Joint  Staff,  the  Office  of  the  Secretary  of  Defense,  and  the 
combatant  commands. One  item  of  note  regarding  this  staff  is  that  it  is 
also  a  directorate  of  DIA  that  draws  heavily  on  its  parent  organization  to 
accomplish  its  myriad  roles. 

As  noted  earlier,  DIA  is  the  peacetime  direct  link  between  the  JIC 
and  other  intelligent  agencies.  In  crisis  situations,  this  link  is  provided  by 
the  National  Military  Joint  Intelligence  Center  (NMJIC),  which  is  operated 
by  the  Joint  Staff  Intelligence  Directorate.  The  NMJIC  not  only  has 
members  representing  the  Directorate’s  own  specialists  in  regional  affairs, 
targeting,  and  operations,  but  it  also  has  members  representing  outside 
organizations  such  as  the  National  Imagery  and  Mapping  Agency  and  the 
National  Security  Agency.  It  is  conceivable,  and  perhaps  even  likely 
that  based  on  current  intelligence  gathering  architectures,  the  Joint  Force 
Commander  will  not  control  all  the  HSI  assets  that  can  sense  the 
commander’s  theater  of  operations.  Naturally,  the  Joint  Force 
Commander  can  task  the  sensors  that  are  under  the  command’s  control, 
but  in  crisis  situations  or  for  sensors  outside  the  Joint  Force  Commander’s 
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control,  the  NMJIC  is  the  point  of  eontaet  for  requests  for  intelligenee 
information.  Additionally,  three  of  the  intelligenee  ageneies  are  outside 
the  Joint  Foree  Commander  eontrol,  yet  they  will  likely  have  a  large  role 
in  HSI.  These  ageneies — the  National  Imagery  and  Mapping  Ageney,  the 
National  Reeonnaissanee  Offiee,  and  the  Central  MASINT 
Organization — are  deseribed  in  the  next  two  paragraphs. 

As  discussed  earlier,  the  National  Imagery  and  Mapping  Agency 
(NIMA)  provides  intelligence  and  geospatial  information  in  support  of 
national  seeurity  objeetives.  To  help  fulfill  this  role,  NIMA  has  an 
Operations  Center  at  the  Pentagon  that  provides  full-time  imagery  analysis 
support  to  the  Joint  Staff  Direetorate  for  Intelligenee,  the  Joint  Foree 
Commander,  eomponents  and  other  joint  staff  members.  Another 
organization  very  elosely  related  to  NIMA  that  will  most  likely  have  a 
large  role  in  HSI  is  the  National  Reeonnaissanee  Offiee  (NRO).  This 
organization’s  mission  is  to  provide  the  United  States  with  spaee-based 
reeonnaissanee.  Though  eurrent  doetrine  indieates  that  the  aequisition 
programs  and  intelligenee  operations  eondueted  by  the  NRO  are  in 
Imagery  and  Signals  Intelligenee,  this  doetrine  eould  be  modified  to  assign 
duties  for  HSI  proeurement  to  NRO.  In  fact,  once  HSI  spaee  sensors  are 
in  orbit,  an  extension  of  eurrent  doetrine  would  lead  to  the  national  level 
MASINT  request  proeess  diseussed  in  the  following  paragraph. 
Unfortunately,  one  issue  that  remains  is  that  joint  doetrine  assigns  no 
organization  with  the  responsibility  of  overseeing  the  proeurement  of 
airborne  systems,  thus  leaving  eaeh  serviee  to  independently  procure  its 
own  airborne  HSI  platforms. 

Tying  these  organizations  together  for  peaeetime  intelligenee 
requests  would  work  as  follows:  a  Joint  Foree  Commander’s  request 
would  first  go  through  the  JIC  and  then  to  DIA.  Next,  the  request  would 
flow  to  NIMA,  whieh  would  then  task  NRO  to  obtain  the  desired  data.  In 
erisis  situations  a  similar  flow  would  oeeur  except  that  eoordination  by  the 
NMJIC  would  be  inserted  between  the  JIC  and  DIA.'^*^ 

The  third  national  level  organization  that  must  be  reviewed  is  the 
Central  MASINT  Organization.  As  its  name  implies,  the  Central  MASINT 
Organization  is  the  MASINT  manager  for  the  DOD  and  other  members  of 
the  intelligenee  eommunity.^^®  As  a  part  of  DIA’s  Direetorate  for 
Intelligenee  Operations,  the  Central  MASINT  Organization  is  eurrently 
seen  as  the  frontrunner  for  leading  HSI  efforts.  Even  the  Senate 
reeognizes  the  organization’s  expertise  in  that  the  Central  MASINT 
Organization  has  been  tasked  by  the  Senate  Committee  on  Intelligenee  to 
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produce  a  Spectral  MASINT  Study  in  2002  that  will  focus  on  issues  such 
as  who  should  be  the  lead  proponent  for  HSI.''^  Though  the 
documentation  would  indicate  that  NIMA  is  particularly  interested  in 
panchromatic  types  of  imagery  products,  because  of  the  spectral  nature  of 
HSI,  it  is  understandable  that  they  would  like  to  play  a  large  role.  But 
later  on  in  this  paper,  it  will  be  shown  that  it  could  be  difficult  for  NIMA 
to  add  HSI  to  its  oversight  because  of  difficulties  already  present  in 
disseminating  the  intelligence  they  currently  produce. 

To  best  conceptualize  how  HSI  should  be  employed  to  bring  out 
the  potential  results  described  earlier,  one  needs  to  look  no  further  than 
existing  joint  doctrine.  Since  there  is  no  argument  that  HSI  definitely  fits 
within  the  intelligence  arena,  then  it  should  be  viewed  in  terms  of  the 
intelligence  cycle  used  by  the  intelligence  community  to  support  the  Joint 
Force  Commander. 

The  Intelligence  Cycle 

The  intelligence  cycle  that  is  shown  in  Figure  1  is  merely  a  model 
of  how  intelligence  functions  are  conducted  and  is  composed  of  six 
phases:  “planning  and  direction;  collection;  processing  and  exploitation; 
analysis  and  production;  dissemination  and  integration;  and  evaluation  and 
feedback.”  Each  of  these  phases  is  described  below,  but  one 
overarching  concept  that  deserves  mention  here  is  that  the  cycle  may  not 
strictly  follow  the  continuum  as  drawn  out  in  the  model.  It  is  not  unusual 
for  the  cycle  to  sometimes  be  cut  short  because  interrelationships  exist 
between  each  of  the  phases.  For  example,  in  some  cases,  the  processing 
and  exploitation  phase  could  be  bypassed  if  data  were  passed  directly  from 
the  sensor  to  the  user  without  having  been  processed  or  exploited. Joint 
Publication  2-01,  “Joint  Intelligence  Support  to  Military  Operations,” 
describes  the  intelligence  cycle  in  detail  and  is  summarized  in  the 
following  paragraphs. 
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Figure  5  The  Intelligence  Cycle 

The  intelligence  cycle  begins  with  a  user  need  in  the  form  of  an 
intelligence  requirement.  The  requirement  sets  the  direction  for  the  first 
phase  of  the  cycle,  Planning  and  Direction.  It  is  likely  this  requirement  is 
just  one  of  many  requirements  before  the  Joint  Force  Commander’s 
intelligence  staff,  which  are  all  prioritized  by  that  staff.  In  principle,  the 
staffs  prioritization  will  focus  all  of  the  various  efforts  in  line  with  the 
Joint  Force  Commander’s  intent. 

The  second  phase.  Collection,  is  where  the  tasking  of  appropriate 
collection  assets  occurs.  To  acquire  the  required  data,  the  intelligence 
staff  will  first  task  the  Joint  Force  Commander’s  own  intelligence  assets. 
If  organic  assets  are  not  available,  then  intelligence  support  may  get  more 
complicated.  Working  through  the  JIC,  the  Joint  Force  Commander’s 
staff  will  request  support  via  DIA  (or  NMJIC  during  a  crisis)  for  external 
support.  In  some  instances  that  require  use  of  high  value,  low-density 
systems  such  as  the  Joint  Surveillance  Target  Attack  Radar  System  aircraft 
and  associated  ground  stations,  the  approval  authority  may  go  as  high  as 
the  Secretary  of  Defense."^ 

Once  data  is  obtained  that  might  meet  the  requirement,  the  cycle 
enters  the  Processing  and  Exploitation  phase.  During  this  phase,  the  raw 
data  (e.g.,  a  hypercube)  is  transformed  into  a  product  that  intelligence 
operators  can  use  in  the  analysis  and  production  of  useable  intelligence 
(e.g.,  a  picture  of  a  tank  partially  hidden  under  trees).  Just  as  the 
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requirements  for  eollection  are  prioritized,  so  too  must  be  the  processing 
and  exploitation  of  the  data  be  prioritized  to  ensure  that  the  most  critical 
information  is  delivered  to  the  decision  maker/ 

The  Production  phase  entails  analyzing  and  evaluating  the 
information  gathered  above  to  prepare  the  finished  product.  Other 
available  sources  of  data  can  also  be  brought  in  to  combine  with  the 
gathered  data.  For  example,  the  Distributed  Common  Ground  Station, 
discussed  earlier,  is  being  designed  to  be  interoperable  with  a  number  of 
“INTs.”  Therefore,  if  either  radar  or  standard  imagery  is  available  for  the 
same  scene  as  an  HSI  hypercube,  then  the  two  could  be  integrated  in  the 
Production  phase  to  provide  the  Joint  Force  Commander  with  a  more 
thorough  view  of  the  battlespace.  To  encourage  such  synergistic 
processing,  a  central  database  of  standardized  HSI  signatures  should  be 
created  and  called  out  explicitly  in  doctrine.  This  would  encourage 
interoperability  between  services  and  also  meet  the  required 
interoperability  between  “INTs.”  Joint  doctrine  already  acknowledges 
that  modem  constraints  on  the  battlefield  are  beginning  to  make  the 
Processing  and  Exploitation  phase  look  “indistinguishable”  from  the 
Production  phase. This  is  not  a  bad  thing.  As  noted  earlier  in  the 
discussion  of  JV  2020,  one  main  vision  for  the  force  of  the  future  is 
decision  superiority  through  overwhelming  operational  tempo  across  the 
full  range  of  operations.  If  HSI  systems  can  help  to  get  finished  products 
to  the  Joint  Force  Commander  faster,  then  the  warfighter  is  one  step  closer 
to  realizing  the  vision. 

The  fifth  phase.  Dissemination  and  Integration,  brings  the 
intelligence  product  from  out  of  the  “art”  of  exploitation  and  returns  it  to 
the  “science”  of  formatting  and  transmission.  Here  the  product  is 
provided  to  the  requester  in  the  required,  standardized  format  so  he  can 
use  the  product  to  help  make  appropriate  decisions  and  planning  choices. 
As  an  aside,  even  though  new  systems  are  being  created  to  provide  users 
with  much  greater  communication  capabilities  than  in  the  past,  the 

producer  of  the  finished  product  needs  to  take  care  not  to  overload  the 
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requester’s  capabilities  to  accept  the  product. 

The  final  phase.  Evaluation,  is  of  concern  to  intelligence  personnel 
at  all  levels.  As  the  cycle  begins  anew,  critical  eyes  must  look  for 
opportunities  to  improve  any  and  every  phase  of  the  cycle.  Eor  example, 
transitions  between  the  various  phases  are  particular  points  to  scmtinize 
for  potential  gains.  In  addition,  the  JIC  is  a  facilitator  that  may  also  help 
cut  down  on  the  intelligence  cycle  by  approving  methods  by  which  the 
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requestors  of  intelligence  can  go  directly  to  the  outside  producers  for 
products  not  typically  produced  by  the  JIC.  Naturally,  it  must  be  the  focus 
of  all  requests  to  obtain  such  direct  information.”^  This  could  have 
implications  to  HSI  depending  on  how  the  overall  HSI  architecture  is 
created.  It  is  easy  to  see  that  many  intelligence  agencies  that  not  directly 
under  the  Joint  Force  Commander  control  will  have  sensing  capabilities 
that  can  be  brought  to  bear  in  the  campaign. 

Tasking,  Processing,  Exploitation,  and  Dissemination 

In  spite  of  the  fact  that  joint  doctrine  identifies  the  conceptual  six- 
phase  approach  described  above  as  the  approved  process,  the  intelligence 
community  often  combines,  or  even  eliminates,  phases  into  a  more 
compact  model  called  the  Tasking,  Processing,  Exploitation,  and 
Dissemination  cycle.  This  cycle  is  by  far  the  most  common  model  found 
in  the  intelligence  literature.  Note  that  even  experts  in  the  intelligence 
cycle  have  difficulty  with  this  model  versus  the  joint  doctrine  cycle.  One 
study  noted,  “It  appears  that  an  acronym  for  the  functions  of  tasking, 
processing,  exploitation,  and  dissemination  has  somehow  become  the 
name  for  an  entity  without  benefit  of  a  common  understanding  of  the 
content.”  Yet  because  of  the  prevalent  use  of  the  abbreviated  model  by 
the  intelligence  community  at  large,  this  paper  will  also  recognize  it  as  the 
model  of  choice.  While  joint  doctrine  phases  (or  parts  of  phases)  such  as 
Production,  Collection,  and  Evaluation  may  not  be  explicitly  included  in 
four-step  model,  the  associated  activities  are  in  fact  still  present  in  the 
process. 

As  discussed  earlier  in  this  paper,  HSI  information  is  particularly 
valuable  when  it  is  combined  with  information  from  other  intelligence 
sources.  With  any  new  system,  the  ultimate  goal  is  to  improve 
intelligence  products,  and  the  benefits  gained  by  leveraging  data  from 
multiple  sources  must  be  continually  reenergized.  One  prognosticator  is 
already  looking  beyond  the  technology  limitations  of  HSI  to  a  time  when 
the  multi-INT  transition  is  seamless: 

[T]he  next  evolutionary  step  would  be  to  collect  and  fuse 
data  from  all  sensory  inputs — optical,  olfactory,  infrared, 
multispectral,  tactile,  acoustical,  laser  radar,  millimeter 
wave  radar.  X-ray,  DNA  patterns,  and  human 
intelligence — to  identify  objects,  people  or  processes.  The 
idea  would  be  to  compare  a  sensory  signature  against  a 
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preloaded  database  to  identify  matehes  or  ehanges  in  the 
signature  for  identifieation  or  eomparison.  Onee  again,  it’s 
just  a  matter  of  time  before  satellites  ean  be  paekaged  with 
stronger  sensors  and  faster  eomputer  paekages  to 
aoeomplish  this  task.'^^ 

The  laek  of  sueh  purposeful  integration  was  one  major  eritique 
during  a  reeent  study  on  NIMA.  The  report  eoneluded  the  Ageney’s  plans 
for  Tasking,  Proeessing,  Exploitation,  and  Dissemination  fail  to  assure 
sueh  integration  between  similar-INT  airborne,  eommereial  and  spaee 
systems  (another  MASINT  sueh  as  Synthetie  Aperture  Radar  for 
example).  In  addition,  NIMA  plans  also  fail  to  address  multi-INT 
integration.  This  problem  is  reeognized  elsewhere  sueh  as  in  the 
Capstone  Requirements  Doeument  for  the  DOD’s  Distributed  Common 
Ground  System.  This  doeument  elaborates  on  these  woes  by  stating  flatly 
that  there  isn’t  enough  Tasking,  Proeessing,  Exploitation,  and 
Dissemination  eapaeity  to  meet  defined  requirements,  and  unfortunately, 
adding  new  sensors  and  teehnology  will  only  worsen  the  problem. 

The  final  major  ehallenge  on  the  way  ahead  is  money.  The  issue 
of  resourees  is  a  fight  that  will  eontinue  when  it  beeomes  time  to  find  the 
money  to  pay  for  HSI.  Where  doetrine  puts  HSI  will  be  a  eritieal  matter 
when  planning  for  this  teehnology’s  future.  The  National  Imagery  and 
Mapping  Ageney  eommission  noted  this  very  topie  when  addressing  their 
findings: 

[T]he  Commission  suggests  that  serious,  far-reaehing 
review  is  required  of  evolving  US  military  doetrine  and  its 
dependenee  on  an  ever-expanding  definition  of  information 
superiority,  so  as  to  determine  the  eontingent  liabilities 
plaeed  on  intelligenee.  These  and  these  alone  must  define 
the  needed  level  of  investment  in  intelligenee  resourees  by 
the  military  serviees.  Anything  less  is  reekless  and 
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irresponsible. 

To  avoid  being  “reekless  and  irresponsible,”  the  intelligenee 
eommunity  will  need  to  make  diffieult  budgeting  deeisions.  Eor  instanee, 
one  of  the  main  foeuses  of  the  NIMA  eommission  report  noted  earlier  was 
the  general  belief  that  the  entire  intelligenee  eommunity  is  too  heavily 
foeused  on  the  eolleetion  aspeet  of  their  work  rather  than  on  tasking  and 
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dissemination.  The  problem  is  that  resourees  are  just  not  available  to 
improve  tasking  and  dissemination  systems  and  modernize  legaey 
systems,  while  at  the  same  time  integrating  multiple  INTs.  The  report 
recognized  the  important  task  of  merging  IMINT  and  SIGINT  is  “a  bigger, 
more  costly,  more  demanding  job  than  the  sum  of  the  two  respective 
pieces  done  separately.”  This  makes  the  report’s  finding  that  no  one  is 
even  planning  for  multi-INT  integration  even  more  disheartening.  Current 
MASINT  literature  does  not  seem  to  indicate  that  it  will  replace  any 
current  systems  but  will  merely  be  added  to  existing  systems.  In  light  of 
all  the  other  taskings  requiring  resources,  it  is  no  wonder  the  report  noted 
that  trying  to  bring  about  the  needed  changes  by  staffing  for  multi-INT 
integration  in  the  government’s  traditional  manner  seems  to  be  “a  nearly 
insuperable  hurdle.”  The  ability  to  find  and  develop  the  needed  personnel 
is  not  there. 

As  has  been  amply  shown  above,  the  DOD  continues  to  devote 
much  energy  to  key  efforts  for  turning  the  dream  of  HSI  into  reality.  Still, 
much  work  remains  to  fulfill  the  promise  of  HSI.  The  next  section 
examines  several  recommendations  that  should  help  promote  successful 
HSI  implementation. 
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IV.  Recommendations 

Organizational  Recommendations 

First,  the  question  of  who  is  in  eharge  of  HSI  needs  to  be  resolved. 
It  may  turn  out  that  no  one  will  be  given  the  lead  in  HSI,  and  the  services 
will  be  left  to  develop  their  own  stove-piped  systems.  This  would  be  a  big 
mistake.  DOD  wants  to  ensure  interoperability  between  the  services,  at 
least  in  the  Processing  phase,  and  these  efforts  should  be  encouraged. 

A  single  organization  could  bring  vital  leverage  that  would  be  lost  if  the 
lead  for  HSI  is  split  among  various  services.  This  paper  recommends  that 
the  Central  MASINT  Organization  be  given  the  responsibility  as  the  lead 
organization  for  all  implementing  all  HSI  platforms.  The  first  reason  for 
this  is  that  HSI  “fits”  better  into  MASINT  than  into  IMINT.  Another 
reason  is  that  within  the  MASINT  community,  the  Central  MASINT 
Organization  already  has  the  leading  role  in  HSI  and  has  the  capability  to 
take  a  broad  view  across  the  DOD.  Pulling  together  the  airborne, 
spaceborne,  theater,  and  national  aspects  described  earlier  into  an 
integrated  technical  architecture  will  be  a  huge  undertaking,  but  the  effort 
needs  to  be  made  if  the  military  is  to  ensure  HSI  reaches  its  full  potential. 

The  essential  requirements  for  such  an  integrated  architecture  can 
already  be  identified  in  joint  doctrine.  Several  key  points  should  be  kept 
in  mind  when  developing  the  integrated  roadmap  for  HSI.  First,  as  this 
paper  has  continually  stressed,  HSI  must  adapt  to  the  Joint  Force 
Commander’s  needs,  supporting  the  full  range  of  missions.  For  example, 
the  system  should  support  the  gamut  of  operations — from  humanitarian 
efforts  to  major  theater  wars.  Second,  the  system  should  avoid  single 
points  of  failure.  A  robust  air,  space,  and  ground  architecture  would  likely 
lead  to  a  very  survivable  capability.  Third,  the  system  must  be  able  to 
accommodate  the  Joint  Force  Commander’s  decision-making  and 
execution  cycle.  The  decreased  processing  time  requirement  noted  earlier 
for  USAF’s  Distributed  Common  Ground  Station  is  merely  one  example 
of  trying  to  speed  up  the  decision-execution  cycle.  Fourth,  the  system 
must  allow  for  operator  training  during  peacetime.  Finally,  to  keep  the 
HSI  system  relevant  to  the  warfighter,  it  must  allow  for  new  technologies 
to  be  incorporated. 
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The  lead  organization  reoommendation  espoused  here  is  not  to  say 
that  the  Central  MASINT  Organization  must  do  all  the  work,  merely  that 
it  should  lead  the  way  through  the  myriad  efforts  that  will  bring  HSI  to 
reality.  For  organizational  purposes,  the  work  should  be  divided  between 
spaee  and  air  systems  with  yet  another  organization  to  review  ground 
station  arehiteetures.  For  example,  the  Central  MASINT  Organization 
should  give  space  architecture  work  to  the  National  Space  Security 
Architect,  and  the  actual  acquisition  of  any  national-level  HSI  satellite 
program  should  be  given  to  NRO.  According  to  joint  doctrine  this  agency 
is  “responsible  for  the  unique  and  innovative  technology,  large  scale 
systems  engineering,  development  and  acquisition,  and  operations  of 
space  reconnaissance  systems  and  related  intelligence  activities  needed  to 
support  global  information  superiority. Though  joint  doctrine  does  not 
currently  give  a  MASINT  satellite  role  to  NRO  (IMINT  and  SIGINT 
only),  the  doctrine  should  be  formally  changed  to  accommodate  the  new 
technology. 

The  DOD  should  not  limit  satellite  acquisitions  to  national-level 
sensors  alone.  Assets  that  could  be  tasked  directly  by  the  Joint  Force 
Commander’s  intelligence  staff  should  also  be  investigated  to  help  fill  any 
gaps  in  coverage  or  decrease  turn-around  time.  Any  satellite  of  this  type 
should  be  given  to  the  Air  Force  to  procure,  because  recent  direction  from 
Secretary  of  Defense  Rumsfeld  has  directed  the  Air  Force  to  become  the 
DOD’s  “Executive  Agent  for  Space. The  Air  Force  Space 
Command/ Air  Combat  Command  draft  HSI  roadmap  is  a  good  start  down 
that  road.  This  document  should  be  finalized  with  appropriate  resources 
and  provided  to  an  acquiring  agency  to  turn  the  requirements  into  a 
working  system. 

Unfortunately  there  is  no  acquisition  agency  similar  to  the  NRO 
for  airborne  sensors.  The  Defense  Airborne  Reconnaissance  Office  was 
designed  to  be  such  an  agency,  but  it  was  disbanded,  and  each  service  has 
been  left  to  create  its  own  airborne  systems.  The  Unmanned  Aerial 
Vehicle  concept  for  airborne  reconnaissance  is  gaining  strength 
throughout  the  DOD,  with  each  service  procuring  its  own  vehicles.  To 
encourage  interoperability  and  reduce  redundancy,  the  Central  MASINT 
Organization,  or  an  organization  working  under  the  auspices  of  the  Central 
MASINT  Organization,  should  work  with  the  services  to  integrate  HSI 
onto  these  new  platforms. 

The  Central  MASINT  Organization  would  also  be  assigned  the 
responsibility  to  oversee  development  of  ground  stations  that  are  capable 
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of  processing  a  wide  variety  of  HSI  data,  ineluding  data  not  eolleeted  by 
the  military,  as  mentioned  earlier.  The  eapstone  requirements  doeument 
for  the  DOD  Distributed  Common  Ground  System  is  pursuing  sueh  a 
vision.  This  doeument  should  be  finalized  to  ensure  the  serviees  work 
toward  eommon  HSI  teehnieal  arehiteetures. 

Another  organizational  ehallenge  that  has  its  roots  in  the 
teehnology  is  the  issue  of  a  eentral  speetral  database.  One  report  noted 
that  speetral  intelligenee  sueh  as  HSI  needs  a  “thorough  eatalog  of  objeets 
and  surfaee  ehemistries  to  deteet  the  meaning  of  this  or  that  refleetion.”'^^ 
In  order  to  reeognize  any  type  of  target  in  a  given  seene,  the  proeessing 
system  must  have  a  standard  against  whieh  to  eompare  the  seene  as  well 
as  a  robust  methodology  to  aecess  the  growing  number  of  eatalogued 
speetral  signatures.  The  eatalog  would  also  need  to  take  into  aeeount  that 
not  all  speetral  signatures  have  the  same  resolution  beeause  these 
signatures  would  have  been  built  using  a  variety  of  sensors.  The  HSI 
eommunity  is  addressing  these  issues  via  several  forums.  One  is  the 
Speetral  Produets  Users’  Group  that  is  developing  the  standard  formats  in 
whieh  HSI  should  be  eommunieated  between  users.  This  “eommon 
language”  is  a  signifieant  first  step  toward  promoting  interoperability 
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between  users. 

The  methodology  being  developed  to  aeeess  a  eommon  database  of 
HSI  produets  is  also  eneouraging.  A  new  organization  ealled  the  National 
Air  Intelligenee  Center  (NAIC)  Speetral  Exploitation  Cell  (NSEC)  is 
being  ereated  at  Wright-Patterson  Air  Eoree  Base,  Ohio,  to  provide  a 
loeation  from  whieh  users  ean  request  and  proeess  HSI  information.  At 
first  NSEC  will  provide  produets  to  its  eustomers  in  an  off-line  mode,  with 
produets  arriving  at  the  customer  within  twenty-four  hours.  Eater,  the 
eapability  will  be  plaeed  on-line.  The  disseminated  information  will 
follow  the  approved  formats  from  the  Speetral  Produets  Users’  Group  and 
will  inelude  both  graphie  and  text  reports.  Additionally,  assured 
interoperability  will  eome  about  beeause  these  reports  will  be  mandated 
aeross  all  serviees  and  systems,  ineluding  the  DOD  Distributed  Common 
Ground  System. 

In  his  final  report  to  Congress,  former  Seeretary  of  Defense  Cohen 
provided  a  fitting  eonelusion  to  the  diseussion  of  organizational  needs  for 
HSI.  He  noted  some  eneouraging  news  for  MASINT  and  HSI  by  pointing 
out  that  in  EY  2000,  the  Central  MASINT  Organization  reeeived  the  first 
inerement  of  a  planned  six-year  resouree  inerease.'^"^  Perhaps  to  defieet 
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some  of  the  Senate’s  stinging  eritieism  from  May  2000,  he  went  on  to  say 
the  following: 

The  foeus  of  the  first  year  was  on  improving  support  to 
joint  military  operations  through  the  ereation  of  MASINT 
operations  and  produetion  eoordination  elements.  DOD  is 
plaeing  partieular  emphasis  on  strategies  and  teehniques  to 
strengthen  MASINT  [Tasking,  Proeessing,  Exploitation, 
and  Dissemination]  and  inerease  analytieal  depth, 
partieularly  in  the  arenas  of  ..multi/hyperspeetral 
information...^^^ 

Doctrinal  Recommendations 

Despite  this  good  news  on  the  organizational  front,  it  seems  that 
even  if  the  teehnology  of  HSI  is  nearly  ready  for  implementation,  it  is 
elear  from  other  evidenee  in  the  earlier  diseussions  that  other  obstaeles 
still  remain.  For  instanee,  doetrine  needs  to  be  updated  to  re  fleet  the 
addition  of  HSI  into  the  MASINT  eommunity  under  the  proposed 
umbrella  organization.  The  doetrine  should  be  explieitly  direetive  to 
ensure  that  resourees  ean  be  provided  to  the  appropriate  ageneies  rather 
than  risk  having  these  same  resourees  spread  aeross  several  ageneies 
whose  primary  role  is  outside  the  MASINT  arena. 

As  diseussed  earlier,  the  intelligenee  eyele  for  Joint  Foree 
Commander  “owned”  assets  is  fairly  straightforward.  Essentially,  the 
Tasking,  Proeessing,  Exploitation,  and  Dissemination  eyele  is  done  within 
the  Joint  Foree  Commander’s  own  intelligenee  staff  strueture.  This  eyele 
beeomes  somewhat  more  ehallenging  when  the  eombatant  eommand 
intelligenee  direetor  needs  to  request  resourees  outside  the  eommand.  In 
this  ease,  existing  joint  doetrine  ean  serve  well  with  only  minor  ehanges. 
For  example,  DIA  eurrently  eoordinates  national  level  requirements,  and 
tasking  is  eurrently  given  through  DIA  to  obtain  IMINT  data  from  the 
NRO  via  NIMA  tasking.  The  link  to  DIA  should  be  applied  to  spaee  HSI 
as  well.'^^ 

It  should  also  not  be  forgotten  that  what  is  valuable  for  an  ally  is 
also  valuable  for  the  enemy.  Doetrine  should  be  reviewed  to  address  the 
implieations  of  adversaries  possessing  HSI  eapabilities.  Even  if  other 
nations’  militaries  are  not  developing  HSI  systems  on  their  own, 
eommereial  systems  are  being  developed  that  have  the  potential  to  be 
exploited  by  our  adversaries.  During  preparation  of  the  intelligenee 
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battlespace,  planners  must  determine  what  the  adversary  hopes  to  achieve 
and  how  HSI  can  help  that  adversary.  Current  joint  doctrine  already 
provides  some  guidance  in  that  efforts  to  prepare  such  information  should 
include,  at  a  minimum,  the  options  available  to  the  adversary,  the 
likelihood  of  these  options  occurring,  and  the  intelligence  needs  to 
determine  more  about  each  option. Similarly,  planners  should  look  at 
any  pieces  of  information  that  HSI  could  reveal  about  allied  military 
posture  in  the  theater  of  operations. 

Other  Key  Recommendations 

In  addition  to  the  organizational  and  doctrinal  issues,  other 
challenges  also  remain.  On  the  technical  front,  acquirers  have  a 
continuing  task  to  ensure  the  station’s  MASINT  capabilities  are 
interoperable  with  all  other  national  and  tactical  agencies.  Additionally, 
these  capabilities  are  to  be  integrated  to  ensure  that  the  multi-INT 
capabilities  are  likewise  preserved.  Simply  said,  “it  goes  both  ways.” 
All  services  should  coordinate  their  MASINT  activities  with  the  ISR 
community  as  a  whole  (i.e.,  not  only  the  MASINT  community)  to  ensure 
their  equipment  can  transmit  their  own  products  while  being  able  to 
receive  and  process  other  services’  products.  The  important  thought  here 
is  that  the  services  will  take  care  to  match  up  with  the  standards  as  they 
are  developed.  Likewise,  other  agencies  need  to  know  what  is  being 
developed  to  ensure  the  full  multi-INT  capability  is  preserved  on  their  end. 

The  long  discussion  of  ground  processing  systems  earlier  in  the 
paper  serves  to  illustrate  the  difficulty  in  bringing  together  the  extensive 
MASINT  community  in  such  a  way  that  it  can  best  serve  the  warfighter. 
Below  are  five  activities  whose  successful  completion  is  essential  to 
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bringing  aboard  these  types  of  processing  systems. 

First,  and  not  surprisingly,  user-validated  requirements  and 
concepts  of  operations  must  be  developed  and  adhered  to.  Items  listed 
earlier,  such  as  standard  formats,  interoperability,  and  multi-INT 
capability,  must  also  be  adhered  to  if  the  Joint  Force  Commander  is  to 
gain  the  greatest  amount  of  information  with  the  minimum  resources. 
Second,  resource  allocation  and  management  is  critical  to  ensure  funding 
and  manning  are  both  appropriate  to  the  task.  It  is  reasonable  to  assume 
that  incorporating  HSI  will  require  more  funding  for  system  acquisition 
and  sustainment  and  must  be  planned  and  budgeted  for  as  early  as 
possible. 
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Third,  systems  integration  (i.e.,  new  sensors  being  added  to  the 
network)  is  going  to  be  very  diffieult.  Without  set  standards  and  databases 
of  speetral  signatures,  it  could  be  very  difficult  to  get  the  services  working 
together.  Though  as  noted  earlier,  some  efforts  are  already  underway  to 
develop  such  standards,  the  acquiring  commands  for  each  service  must  be 
cautiously  vigilant  to  ensure  that  the  hardware  and  software  of  new 
sensors  are  compatible  with  the  existing  baseline.  Likewise,  the  services 
must  continue  to  pay  very  close  attention  to  the  needed  communications 
requirements.  In  fact,  the  DOD  Distributed  Common  Ground  System 
capstone  document  reminds  the  readers  that  DOD  instructions  require  the 
services  to  prepare  the  communications  support  plans  to  ensure  that 
communication  requirements  are  known  and  accounted  for  before  systems 
are  introduced  to  the  field. 

Fourth,  operational  integration  (e.g.,  changes  to  the  processing 
station  baseline)  is  going  to  be  a  challenge  as  well.  It  is  imperative  that 
strong  change  management  processes  be  used  to  ensure  that  baseline 
capabilities  are  not  degraded.  Thorough  test  and  evaluation,  attentiveness 
to  standards  (machine  and  human  factors),  plus  prior  use  in  experiments 
will  help  ensure  these  types  of  changes  are  successful. 

Fifth,  just  as  those  who  are  responsible  for  operational  integration 
need  to  pay  close  attention  to  human  factors,  implementers  must 
remember  the  human  element  of  Training  and  Education.  HSI  is  not 
standard  imagery;  so  standard  imagery  training  alone  will  not  suffice. 
Training  should  not  merely  be  an  afterthought,  but  it  must  be  integrated 
into  development.  Training  will  be  of  concern  at  all  levels  of  the  joint 
force  and  should  become  standardized.  As  noted  earlier  in  the  ground 
processing  discussion,  training  for  the  analysts  will  be  critically  important. 
Also,  just  as  the  Central  MASINT  Organization  has  contracted  for  training 
programs  based  on  the  level  of  detail  needed  for  each  individual,  so  too 
should  the  organization  overseeing  HSI  prepare  a  training  plan  for 
personnel  from  the  imagery  analyst  up  to,  and  including,  at  least  the 
director  of  the  Joint  Force  Commander’s  intelligence  staff.  If  the  lead 
organization  does  not  do  the  actual  training  plan,  then  the  services  must.'"^^ 
The  service-based  training  approach  is  not  the  preferred  method  since  it 
could  invite  redundancies  into  the  training  schemes,  especially  if  each 
service  prepares  their  own  plans  without  integrating  with  other 
intelligence  organizations.  Though  each  service  may  choose  to 
independently  procure  training  for  operators,  this  does  not  necessarily 
need  to  be  the  case.  Because  the  MASINT  community  will  be  growing 
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and  many  organizations  will  be  involved,  these  organizations  may  be  able 
to  leverage  off  of  eaeh  others’  training  programs. 

No  matter  what  the  final  training  plan  looks  like,  as  with  other 
eareer  speeialties,  the  training  for  the  operators  must  be  eontinuous, 
advaneing  methodieally  from  the  basic  through  advanced  levels. It  is 
not  clear  at  this  point  whether  or  not  the  Joint  Force  Commander  needs  to 
receive  anything  other  than  the  briefest  HSI  overview  because  of  the 
“finished”  nature  of  the  HSI  products  by  the  time  they  reach  that  level  of 
command.  As  shown  in  the  series  of  photos  at  the  top  of  the  paper,  raw 
HSI  data  reveals  little  to  the  human  eye;  so  it  seems  unlikely  that  the  Joint 
Force  Commander  will  be  presented  such  information. 

In  addition  to  standardized  training,  HSI  capabilities  must  be 
continuously  integrated  into  wargames,  exercises,  and  demonstrations  to 
improve  the  operators’  performance  as  well  as  improve  the  methods  by 
which  HSI  is  incorporated  into  campaigns.  Air  Force  doctrine  is  a  strong 
proponent  for  such  a  proposal,  reasoning: 

Exercises  provide  realistic  training  that  is  essential  for 
proficiency  and  readiness.  Realistic  exercises  determine 
possible  shortfalls  and  corrective  actions  to  achieve  success 
in  future  operations.  Exercises  train  individuals,  units,  and 
staffs  in  the  necessary  skills  and  tools  for  ISR  operations 
and  ensure  that  staffs  can  plan,  control,  and  support  such 
operations. 

In  fact,  HSI  has  already  been  incorporated  into  at  least  one 
experiment,  JEEX  2000  (5-15  Sep  00).  Using  both  air  and  spaceborne 
sensors  such  as  MightySat  II.  1,  the  HSI  portion  of  the  experiment 
attempted  to  meet  many  objectives.  Eirst,  experimenters  attempted  to 
show  that  one  workstation  could  process  hypercubes  from  multiple 
sensors.  Second,  they  evaluated  the  functionality  of  four  software 
programs  for  processing  HSI,  including  the  Common  Spectral  MASINT 
Exploitation  Capability  and  ENVI  discussed  earlier.  They  evaluated  Air 
Eorce  Distributed  Common  Ground  Station  hardware  and  software 
requirements  against  the  HSI  systems  used  in  the  experiment.  Next,  they 
attempted  to  get  a  sense  of  what  is  needed  in  terms  of  operator  training 
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requirements. 

The  results  of  the  experiment  were  very  positive  for  HSI.  Analysts 
and  evaluators  agreed  that  HSI  is  now  at  a  sufficient  level  of  maturity  to 
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provide  useful  information  to  the  Joint  Foree  Commander.  In  faet, 
operators  were  able  to  find  targets  not  detected  by  the  electro-optical  or 
radar  systems.  In  addition,  the  use  of  the  Spectrally  Enhanced  Broadband 
Array  Spectrograph  System  long  wavelength  infrared  sensor  showed  that 
by  using  the  emissive  properties  of  materials,  it  can  in  fact  differentiate 
targets,  a  huge  boon  when  operating  at  night  or  through  cirrus  clouds. 
On  the  down  side,  because  this  evaluation  took  place  in  an  experiment 
rather  than  an  exercise,  the  suite  of  sensors,  processors,  and  people  were 
far  from  standardized  in  terms  of  doctrine,  organization  or  training. 
Nevertheless,  the  exercise  clearly  showed  that  such  issues  could  be 
resolved.  As  might  be  expected,  using  systems  mixed  in  an  essentially  ad 
hoc  manner  rather  than  an  integrated  one,  led  to  some  conclusions  that  the 
“system”  is  not  yet  capable  of  meeting  a  warfighter’s  time  critical 
information  requirements.  Additionally,  the  issue  of  the  slow  processing 
of  full  hypercubes  also  arose. Yet,  this  experiment  shows  the  value  of 
taking  advantage  of  such  opportunities  on  a  continuing  basis. 

In  addition  to  the  JEFX  experiment  noted  above,  on  5  March  2002, 
the  Under  Secretary  of  Defense  for  Acquisition,  Technology  and  Eogistics 
announced  that  an  HSI  project  has  been  funded  for  an  Advanced  Concept 
Technology  Demonstration,  or  ACTD.'"^^  ACTDs  “emphasize  technology 
assessment  and  integration  rather  than  technology  development.  The  goal 
is  to  provide  a  prototype  capability  to  the  warfighter  and  to  support  him  in 
the  evaluation  of  that  capability.  The  warfighters  evaluate  the  capabilities 
in  real  military  exercises  and  at  a  scale  sufficient  to  fully  assess  military 
utility.”^"^^  The  HSI  ACTD,  called  the  Hyperspectral  Collection  and 
Analysis  System,  will  integrate  a  variety  of  HSI  sensors  onto  different 
platforms  (e.g.,  manned  and  unmanned  aircraft  and  satellites).  It  will  be 
used  to  show  the  utility  of  an  integrated  HSI  system  in  such  areas  as 
search  and  rescue,  counter  camouflage,  and  the  search  for  weapons  of 
mass  destruction. 

The  11  September  2001  attacks  appear  to  have  caused  some 
dramatic  positive  shifts  in  funding  priorities  in  addition  to  the  new  ACTD 
noted  above.  As  reported  in  a  December  2001  issue  of  Defense  News,  just 
two  months  after  the  attacks  several  information  technology  units  of  major 
defense  contractors  were  awarded  study  contracts  worth  about  $100 
million  to  develop  a  computer  network  named  Multi-ISR  (for  Intelligence, 
Surveillance,  and  Reconnaissance).^^*’  Though  no  government  officials 
would  publicly  acknowledge  the  existence  of  the  contracts,  the 
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Intelligence  Authorization  Act  2002  Conference  Report  highlights 
investment  in  new  technologies  for  collection  processing  and  analysis/^' 

The  process  for  funding  HSI  is  not  particularly  mysterious.  The 
intelligence  resource  process  is  broken  into  three  major  categories  used  to 
represent  the  three  broad  uses  of  the  intelligence — strategic,  operational 
and  tactical.  Strategic  intelligence  is  for  use  primarily  by  the  President, 
Secretary  of  Defense  and  other  very  high  level  military  and  political 
leadership.  The  category  name  for  procuring  strategic  level  systems  is 
called  the  National  Foreign  Intelligence  Program.  This  procurement  level 
is  not  the  focus  of  this  paper,  but  certainly  HSI  products  could  be  used  at 
this  level  to  help  decisionmakers  with  national  policy  and  military 
strategy.  As  noted  earlier,  in  combination  with  other  intelligence  methods, 
HSI  could  be  used  for  such  national  level  concerns  as  treaty  verification. 
Procurement  dollars  for  an  NRO  HSI  system  would  come  from  this 
funding  source.  Though  the  focus  of  an  HSI  system  acquired  under  the 
National  Foreign  Intelligence  Program  would  be  strategic  in  nature,  it 
should  not  be  assumed  that  this  would  exclude  its  usefulness  to  a  Joint 
Force  Commander.  Certainly  national  level  systems  can  be  and  are  used 
to  support  the  commander’s  intelligence  preparation  of  the  battlespace  for 
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campaign  planning  or  indications  and  warnings. 

The  resource  category  for  the  operational  level  of  intelligence  is 
known  as  the  Joint  Military  Intelligence  Program.  This  level  of 
intelligence  resource  allocation  is  at  the  heart  of  the  current  discussion  on 
how  HSI  can  support  a  Joint  Force  Commander  overseeing  multiple  DOD 
components.  This  funding  source  was  established  to  improve  DOD 
intelligence  efforts  when  those  efforts  require  resources  from  more  than 
one  DOD  component  or  the  customers  of  the  produced  data  come  from 
more  than  one  component.  In  addition  to  supporting  the  warfighter,  this 
funding  source  also  supports  policymakers  and  modernization  planners  by 
helping  bring  increased  effectiveness  to  the  planning  and  oversight  of  this 
level  of  intelligence  activity.  The  Joint  Military  Intelligence  Program 
could  justifiably  fund  programs  such  as  a  non-NRO  space-based  HSI 
system.  Airborne  platforms  could  likewise  receive  funding  from  the  Joint 
Military  Intelligence  Program. 

The  third  level  of  intelligence  resourcing  is  called  Tactical 
Intelligence  and  Related  Activities.  This  funding  is  focused  on  individual 
services  or  agencies  and  where  the  customer  is  at  the  operational  and 
tactical  level.  These  levels  usually  include  the  “corps,  wing,  naval  battle 
group,  and  Marine  expeditionary  force  level  and  below. While  this 
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level  of  intelligenee  funding  from  this  source  may  be  too  low  for 
procuring  an  HSI  sensor,  it  may  be  very  applicable  to  each  services  for 
acquiring  processing  stations  or  their  follow-ons  (e.g.,  Distributed 
Common  Ground  System).  However,  this  particular  application  does 
reinforce  the  requirement  to  appoint  a  lead  HSI  organization  to  ensure  HSI 
remains  integrated  across  the  services. 

The  lead  organization  concept  noted  earlier  in  this  section  would 
be  given  the  responsibility  of  negotiating  the  various  methods  by  which 
each  HSI  system  would  be  programmed  and  budgeted.  The  lead 
organization  would  also  need  to  work  closely  with  the  other  “INT” 
agencies  to  ensure  that  HSI  is  properly  integrated  with  the  larger 
intelligence  arena. 

Conclusions 

The  time  has  arrived  for  Hyperspectral  Imagery — theory  and 
technology  can  now  intersect.  The  main  question  is,  does  the  nation  have 
the  will  to  devote  the  proper  effort  to  HSI  to  turn  it  into  reality?  This 
paper  has  reviewed  the  benefits  of  HSI  to  the  warfighter  as  well  as  some 
of  the  current  systems  that  show  why  HSI  has  now  moved  into  the  art  of 
the  possible.  The  view  is  encouraging  on  many  fronts.  Several  airborne 
sensors  are  already  in  operation  and  the  number  of  spacebome  sensors 
continues  to  increase.  Ground  stations  and  software  programs  within 
those  stations  are  maturing,  and  it  is  also  clear  that  much  thought  on  the 
military  side  has  been  developed  to  ensure  that  these  ground  stations 
maximize  interoperability.  This  interoperability  is  being  further  enhanced 
by  standardized  formats  and  the  proposed  central  database  for  data 
products.  So  too,  the  funding  for  HSI  appears  to  be  on  the  rise.  The 
MASINT  umbrella  under  which  HSI  primarily  resides  has  strong  support 
in  our  nation’s  legislature. 

Still,  other  challenges  remain.  The  primary  question  of  “Who’s  in 
charge?”  remains.  This  paper  recommends  that  the  Central  MASINT 
Organization  be  assigned  that  role  to  ensure  the  services  proceed  with 
their  programs,  not  only  to  ensure  interoperability  but  also  to  avoid 
redundancy  and  the  associated  opportunity  costs.  Just  as  new 
organizational  structures  will  be  required,  updates  to  joint  and  service 
intelligence  doctrine  will  be  needed  as  well.  On  paper  it  appears  that  this 
could  be  relatively  simple,  yet  doctrine’s  impact  on  funding  will  likely 
introduce  some  conflict.  Finally,  many  of  the  technology  issues  are  being 
solved,  but  others  continue  to  pose  problems.  Tasking,  Processing, 
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Exploitation,  and  Dissemination  will  continue  to  be  difficult,  especially  as 
HSI  is  tied  into  the  “multi-INT”  arena.  To  avoid  difficulties  from  stove- 
piped  systems,  integration  of  new  systems,  and  the  myriad  tasks  that  go 
along  with  that  integration  (e.g.,  training),  will  require  close  scrutiny.  Yet 
even  with  the  challenges  that  await  the  Hyperspectral  Imagery  community, 
the  future  looks  bright,  in  no  matter  what  wavelength  you  are  looking. 
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